-- Logs begin at Mon 2022-07-25 11:57:00 UTC, end at Mon 2022-07-25 13:15:38 UTC. -- Jul 25 12:29:43.577699 dv-cinder-825492-28-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 12:29:43.588168 dv-cinder-825492-28-smb devstack@keystone.service[80484]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 12:29:43 2022] *** Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: nodename: dv-cinder-825492-28-smb Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: machine: x86_64 Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: clock source: unix Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: pcre jit disabled Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: detected number of CPU cores: 4 Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: current working directory: / Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: detected binary path: /usr/bin/uwsgi-core Jul 25 12:29:43.590202 dv-cinder-825492-28-smb devstack@keystone.service[80484]: your processes number limit is 47680 Jul 25 12:29:43.590834 dv-cinder-825492-28-smb devstack@keystone.service[80484]: your memory page size is 4096 bytes Jul 25 12:29:43.590834 dv-cinder-825492-28-smb devstack@keystone.service[80484]: detected max file descriptor number: 2048 Jul 25 12:29:43.590834 dv-cinder-825492-28-smb devstack@keystone.service[80484]: lock engine: pthread robust mutexes Jul 25 12:29:43.590834 dv-cinder-825492-28-smb devstack@keystone.service[80484]: thunder lock: enabled Jul 25 12:29:43.590834 dv-cinder-825492-28-smb devstack@keystone.service[80484]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 12:29:43.590834 dv-cinder-825492-28-smb devstack@keystone.service[80484]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 12:29:43.630494 dv-cinder-825492-28-smb devstack@keystone.service[80484]: Python main interpreter initialized at 0x563965c739c0 Jul 25 12:29:43.630494 dv-cinder-825492-28-smb devstack@keystone.service[80484]: python threads support enabled Jul 25 12:29:43.630494 dv-cinder-825492-28-smb devstack@keystone.service[80484]: your server socket listen backlog is limited to 100 connections Jul 25 12:29:43.630494 dv-cinder-825492-28-smb devstack@keystone.service[80484]: your mercy for graceful operations on workers is 90 seconds Jul 25 12:29:43.630944 dv-cinder-825492-28-smb devstack@keystone.service[80484]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 12:29:43.630944 dv-cinder-825492-28-smb devstack@keystone.service[80484]: *** Operational MODE: preforking *** Jul 25 12:29:43.631219 dv-cinder-825492-28-smb devstack@keystone.service[80484]: *** uWSGI is running in multiple interpreter mode *** Jul 25 12:29:43.631219 dv-cinder-825492-28-smb devstack@keystone.service[80484]: spawned uWSGI master process (pid: 80484) Jul 25 12:29:43.631417 dv-cinder-825492-28-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 12:29:43.635942 dv-cinder-825492-28-smb devstack@keystone.service[80484]: spawned uWSGI worker 1 (pid: 80496, cores: 1) Jul 25 12:29:43.635942 dv-cinder-825492-28-smb devstack@keystone.service[80484]: spawned uWSGI worker 2 (pid: 80497, cores: 1) Jul 25 12:29:43.635942 dv-cinder-825492-28-smb devstack@keystone.service[80484]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 12:29:49.126161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:29:49.126161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: from cryptography.utils import int_from_bytes Jul 25 12:29:49.127006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:29:49.127006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: from cryptography.utils import int_from_bytes Jul 25 12:29:49.127128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:29:49.127128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes Jul 25 12:29:49.127128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 12:29:49.127128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: from cryptography.utils import int_from_bytes Jul 25 12:29:49.176381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:29:49.176554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:29:49.176738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 12:29:49.176833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] command line args: [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:29:49.176936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 12:29:49.177023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:29:49.177131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] command line args: [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 12:29:49.177222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ================================================================================ {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:29:49.177401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] admin_token = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.177502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 12:29:49.177603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ================================================================================ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 12:29:49.177682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] config_dir = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.177817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.177910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.177989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] config_source = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] config_dir = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] debug = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] config_source = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] debug = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.178889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179542 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.179909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_config_append = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_config_append = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_dir = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_file = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_dir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.180918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.181963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.182950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.183903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] publish_errors = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] publish_errors = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.184940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] standard_threads = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] standard_threads = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.185921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] use_journal = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] use_json = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] use_stderr = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] use_journal = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] use_syslog = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] use_json = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.186954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] use_stderr = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.187106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] use_syslog = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.187179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.187250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 12:29:49.187344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.187499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.187584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.187739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.187819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.188994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.189955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.190962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.191954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.192939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.193942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.194874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.195985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196065 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.196992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.197961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.198983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.199956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.213968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214051 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.214990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.215862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.216931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.217974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218648 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.218955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.219912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.external = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.220997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.external = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.password = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] auth.token = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.221802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.222544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.222632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.222714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.password = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.222794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.222874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] auth.token = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.222957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.223954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.224931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.225973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.226949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.227952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.228931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229297 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.229955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.230998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.231928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.232977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.233946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.234925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.235955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.236928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.237996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238862 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.238934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.239975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.240917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.241867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.242963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.243906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] role.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] role.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.244944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.245100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.245180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.245337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] role.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.245685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.245842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.245922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] role.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.246878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.247841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.248892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.249972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.250932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.251891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.252983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.253072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.253304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.253432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.253717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.253806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.254000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.254165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.254529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.254609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.254878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.254993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.255936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.256886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.257996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.connection = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.258967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.259909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.260946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.261895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:29:49.262744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.262972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.263205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.263445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.263681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 12:29:49.263852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 12:29:49.292334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.292559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.292784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.292887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.293107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.293335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.301839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.302197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.331837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.332049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.332138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.332285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.384407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.384744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.434867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.435097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.435814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.436076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.500326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.500486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.500578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.500722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.500811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.500948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.501103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.501193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.501270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.501374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.501460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.501586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.524825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.524940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.525918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.526052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.526198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.526346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.526481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.526615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.537693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.537877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.550361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.550582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.550720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.550853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.551970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80497) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.552091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.552091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80496) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 12:29:49.569248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.569456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:29:49.569791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.569954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.570084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:29:49.570211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:29:49.570346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.570474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.570598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.570724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 12:29:49.570849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.570975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.571109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.571235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.571395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.571644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.582316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.582587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.582854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.582981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.583166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.583298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.583505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.583777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.591366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.591950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.594652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.594930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.595197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.595327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.595475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.595604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.595755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.595889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.596925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.597115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.597193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.597377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.597507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.597743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.598007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.625392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.626243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.627011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.627289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.627837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.628690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.633184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.633574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.633856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.633936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.634302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.634621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.641104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.641384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.641792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.642069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.646452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.646732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.647285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.647988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.648116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.648262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.648380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.648532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.648799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.649063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.667164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.667444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.667529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.667779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.672066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.672379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.675742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.676166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.676360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.676757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.681176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.681749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.684817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.685450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.688463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.688782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.689960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.690138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.690420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.710491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.710597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.710769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.710865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.711036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.711129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.711291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.711382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.719156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.719250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.720879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.720974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.721153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.721245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.724389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.724505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.724667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.724761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.724949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.725042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.725225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.725317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.725495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.725588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.738919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.739017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.739206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.739300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.739480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.739572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.739756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.739856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.740148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.740240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.740422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.740514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.740690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.740781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.759256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.759353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.762530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.762639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.765843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.765939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.767587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.767680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.769948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.770060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.770225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.770318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.770504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.770596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.777841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.777983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.779524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.779617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.782746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.782869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.783029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.783157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.783409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.783495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.783694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.783781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.792850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.793066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.793152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.793350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.793436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.793623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.801266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80497) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.801479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80496) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 12:29:49.801593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.801753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.801843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.802931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.803829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80497) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.804910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.805083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80496) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 12:29:49.843060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563965c739c0 pid: 80497 (default app) Jul 25 12:29:49.843259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563965c739c0 pid: 80496 (default app) Jul 25 12:29:49.846520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62fc2-5120-448b-a5f3-ab2c559a201a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:29:49.847332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62fc2-5120-448b-a5f3-ab2c559a201a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:29:49.847613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62fc2-5120-448b-a5f3-ab2c559a201a None None] PATH_INFO: `/v3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:29:49.851827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Mon Jul 25 12:29:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:29:58.211451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:29:58.212039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:29:58.212039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:29:58.216396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:29:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:29:58.221715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:29:58.222145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:29:58.222275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:29:58.293889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: INFO dbcounter [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] Registered counter for database keystone Jul 25 12:29:58.315229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG oslo_db.sqlalchemy.engines [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:29:58.321626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writer thread running {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:29:58.498057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80497) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 12:29:58.498443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG passlib.handlers.bcrypt [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80497) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 12:29:58.552920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:29:58.554538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:29:58.677390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:29:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 12:29:58.798960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:29:58.868760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: INFO dbcounter [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] Registered counter for database keystone Jul 25 12:29:58.888893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG oslo_db.sqlalchemy.engines [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 12:29:58.894976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writer thread running {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 12:29:59.014774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12315ef-1237-4a97-a0e3-ee8335210139 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:29:59.018948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:29:59.019650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:29:59.019952 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:29:59.020234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:29:59.028250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:29:59.078595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 12:29:59.078881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eeaeb-b335-4b53-ab08-c47fbbf88f9e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:29:59.088411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Mon Jul 25 12:29:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:29:59.094547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:29:59.108769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c960e3b-2ba7-44af-a476-9c5c9b777528 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:29:59.114098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:29:59.115201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:29:59.115483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:29:59.115754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] PATH_INFO: `/v3/projects/008d6127b7814e42964dd897d624be5f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:29:59.117288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] RBAC: Authorizing `identity:get_project(project_id=008d6127b7814e42964dd897d624be5f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:29:59.170001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 12:29:59.170346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a3f24-09c2-4d47-a8f7-6cd9b28e5ff8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:29:59.174879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Mon Jul 25 12:29:59 2022] GET /identity/v3/projects/008d6127b7814e42964dd897d624be5f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:01.140906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2363f2-91af-4c42-9980-85f9e3d02cfb None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:01.141444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2363f2-91af-4c42-9980-85f9e3d02cfb None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:01.141444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2363f2-91af-4c42-9980-85f9e3d02cfb None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:01.146381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:01.151649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:01.152056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:01.152236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:01.172484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:01.174013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:01.181971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 12:30:01.203011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2363f2-91af-4c42-9980-85f9e3d02cfb None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:01.215327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2363f2-91af-4c42-9980-85f9e3d02cfb None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:01.219518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36cd9c-02cb-45a9-bfe3-4f653bb806e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:01.220174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36cd9c-02cb-45a9-bfe3-4f653bb806e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:01.220455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36cd9c-02cb-45a9-bfe3-4f653bb806e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:01.220727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36cd9c-02cb-45a9-bfe3-4f653bb806e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:01.228946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36cd9c-02cb-45a9-bfe3-4f653bb806e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:01.230710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36cd9c-02cb-45a9-bfe3-4f653bb806e1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:01.239379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Mon Jul 25 12:30:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:30:01.244535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:01.254048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366fd53-ee3c-40f3-8a1a-f14b179cb5af None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:01.258401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca731e-95a7-45f8-94ba-fc2dad194b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:01.259254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca731e-95a7-45f8-94ba-fc2dad194b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:01.259533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca731e-95a7-45f8-94ba-fc2dad194b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:01.259804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca731e-95a7-45f8-94ba-fc2dad194b75 admin admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:01.261210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca731e-95a7-45f8-94ba-fc2dad194b75 admin admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:01.263015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca731e-95a7-45f8-94ba-fc2dad194b75 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:01.264600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Mon Jul 25 12:30:01 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:03.303459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e2df-dd21-4709-aa17-f9557012f62a None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.304053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e2df-dd21-4709-aa17-f9557012f62a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.304053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e2df-dd21-4709-aa17-f9557012f62a None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.305387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:03.310524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.310922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.311082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.327098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b01c-7ed1-453c-a0b6-3bc0d9e0d5c0 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.327387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b01c-7ed1-453c-a0b6-3bc0d9e0d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.327671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b01c-7ed1-453c-a0b6-3bc0d9e0d5c0 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.329057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:03.330356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:03.332222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:03.335134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.335425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.335707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.379661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG passlib.handlers.bcrypt [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80496) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 12:30:03.380109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG passlib.handlers.bcrypt [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80496) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 12:30:03.413838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 6/12] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:03.425645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:03.427346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:03.436502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:03.461820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:03.525678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 7/13] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:03.543160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d49cfe-d978-4f17-b259-8669234fdf0c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:03.546808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:03.578692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:03.579741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.580056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.580339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.591722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:03.603139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:03.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:03.605540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 7/14] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:03.610004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:03.652269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152849b5-a1b8-4e6c-b149-bd7bf5d44446 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:03.654856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:03.692778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:03.693658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.693948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.694229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.695294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:03.713426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2734-e74f-4275-ad6d-d550edf02bdd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:03.748290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:03.748957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.749240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.749518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.750271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:03.750578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:03.752007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:03.764398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:03.764547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 8/15] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:03.765925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:03.770784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:03.864404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 8/16] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:03.869835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:03.870592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce33d-c6ec-4ad3-b828-406870d36620 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:03.872748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:03.905037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:03.905912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:03.906196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:03.906472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:03.907678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:03.909189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:03.910907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 9/17] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:03 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:03.916270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:03.930345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:03.967171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a999d-3bd9-4c2c-9c1d-641e7aae000a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:04.000527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:04.001566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:04.001852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:04.002128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:04.016858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df224a69-1343-4675-98a4-2cbca99fcf2b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:04.021275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:04.022768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:30:04.044012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:04.045021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:04.045876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:30:04.045876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:30:04.045876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:30:04.045876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:04.045876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 9/18] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:04.051593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:04.053729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:04.054559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:04.054841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:04.055114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:04.056317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:04.057769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:04.059358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 10/19] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:04.064857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:04.107215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:04.144815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:04.152601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd0e4-54f2-4a0f-ae90-baf4393b7b4b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:04.163491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36aea7-8143-4bdb-9906-e70c188d2c65 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:04.186517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:04.187183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:04.187472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:04.187756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:04.188526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:04.188840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:04.190266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4cbbc-3e07-4ee7-a89c-b718f3c9cff2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:04.196953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:04.197606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:04.197871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:04.198142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:04.198994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.domain.id=default, user.id=98bd6a1dc7ae4125860c8750461c1fa5) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:04.199302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:04.200778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70b12f-74ca-4a79-8a6a-c058fa29d2f2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:04.207965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1322 bytes} [Mon Jul 25 12:30:04 2022] GET /identity/v3/role_assignments?user.id=98bd6a1dc7ae4125860c8750461c1fa5&scope.domain.id=default&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:04.208540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:06.563608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eda74-60aa-4840-a624-40a797c1f496 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:06.564151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eda74-60aa-4840-a624-40a797c1f496 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:06.564225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eda74-60aa-4840-a624-40a797c1f496 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:06.565590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:06.571063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:06.571956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:06.572454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:06.597642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:06.599309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:06.648153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c93e-43f4-4fa0-bd1c-dfe92b826814 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:06.648793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c93e-43f4-4fa0-bd1c-dfe92b826814 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:06.649275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c93e-43f4-4fa0-bd1c-dfe92b826814 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:06.650837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 13/23] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:06.663760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:06.664390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:06.664891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:06.705633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:06.707695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:06.715940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 11/24] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:06.742864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:06.832770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:06.858536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 14/25] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:06.905732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:06.907748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5b105-93cb-4f98-8a2c-35ba5b064fa2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:06.951407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be277c6f-40c5-4c6b-9fde-3dd37ee845ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:06.952509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be277c6f-40c5-4c6b-9fde-3dd37ee845ae None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:06.952958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be277c6f-40c5-4c6b-9fde-3dd37ee845ae None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:06.953387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be277c6f-40c5-4c6b-9fde-3dd37ee845ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:06.970974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be277c6f-40c5-4c6b-9fde-3dd37ee845ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-be277c6f-40c5-4c6b-9fde-3dd37ee845ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:06.985596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:06.986499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:06.987271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:06.990643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 12/26] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:06.992125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c84ce-c341-4f19-89ba-39d45a9d098e None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:06.992616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c84ce-c341-4f19-89ba-39d45a9d098e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:06.993085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c84ce-c341-4f19-89ba-39d45a9d098e None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:06.994546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:07.000765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c84ce-c341-4f19-89ba-39d45a9d098e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:07.044149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:07.087129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd1025-3df3-410f-8555-4ebd5084e4ec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:07.192210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c84ce-c341-4f19-89ba-39d45a9d098e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:07.200664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:07.245916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:07.247019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.247521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.248027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.249021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:07.249551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:07.251172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc51d7-aac9-44be-a0d3-4ed535d36028 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:07.265618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 14/28] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:07.267357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ece3-af6f-4fee-bf34-265f2d3d09f5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.267880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ece3-af6f-4fee-bf34-265f2d3d09f5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.268444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ece3-af6f-4fee-bf34-265f2d3d09f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.294015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-fb03ece3-af6f-4fee-bf34-265f2d3d09f5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:07.295394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fb03ece3-af6f-4fee-bf34-265f2d3d09f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:07.301915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:07.302882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.303371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.303840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.304836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:07.306527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:07.371712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:07.372773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d31cd1-6477-4498-97cd-8218809e01b9 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.373067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d31cd1-6477-4498-97cd-8218809e01b9 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.373350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d31cd1-6477-4498-97cd-8218809e01b9 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.378933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:07.378933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d31cd1-6477-4498-97cd-8218809e01b9 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:07.486707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:07.492102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d31cd1-6477-4498-97cd-8218809e01b9 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:07.529548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67634ae3-88f4-4b3a-bba3-1e7becc16c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:07.530556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67634ae3-88f4-4b3a-bba3-1e7becc16c56 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.530908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67634ae3-88f4-4b3a-bba3-1e7becc16c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.531250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67634ae3-88f4-4b3a-bba3-1e7becc16c56 None admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.532914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67634ae3-88f4-4b3a-bba3-1e7becc16c56 None admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:07.534598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67634ae3-88f4-4b3a-bba3-1e7becc16c56 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:07.536812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 17/31] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:07 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:07.538261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.538611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.538957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.558163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:07.559624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:07.573662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 15/32] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Jul 25 12:30:06 2022] POST /identity/v3/roles => generated 219 bytes in 668 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:30:07.575489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:07.696586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 18/33] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:07.697602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:07.779868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbca57-23f1-4c06-ba80-6d9371f35900 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:07.827253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:07.828548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.828835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.829112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.836040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:07.845907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:07.848240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:07.858215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:07.865719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592fd07-965d-4e77-86ac-2d28c219c4f1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:30:07.871385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:07.872271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:07.873068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:30:07.873068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:30:07.873068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:30:07.873068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:07.873068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 16/34] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:07.876994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:07.910582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:07.911937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:07.912231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:07.912790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:07.914162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:07.916262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:07.918551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 19/35] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:07.919160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:08.011802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4303355-ec8f-4eca-a3eb-29203da2bcfa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:08.050680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:08.051509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.051796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.052113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.052898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:08.054330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:08.139448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 17/36] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Jul 25 12:30:07 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:08.141218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:08.148108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77b4a2-c988-41a1-9c4c-631e6c8305d8 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:08.198371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:08.199059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.199342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.199620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.200400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:08.201476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:08.203079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cefefe-c249-419d-a003-ef34c24ac784 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:08.210565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:08.221560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 20/37] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:08.221560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baafdb-4fdd-4287-a513-ced6fca1e7e5 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.221560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baafdb-4fdd-4287-a513-ced6fca1e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.221560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baafdb-4fdd-4287-a513-ced6fca1e7e5 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.221560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 21/38] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:08.221560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44dad-f79e-4f91-a7e4-85a1cfe368b9 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.222354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44dad-f79e-4f91-a7e4-85a1cfe368b9 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.222354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44dad-f79e-4f91-a7e4-85a1cfe368b9 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.223867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 22/39] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:08.228247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb44dad-f79e-4f91-a7e4-85a1cfe368b9 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:08.257850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:08.280906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56688e9a-fb4f-4d4f-8d70-ca12ae4bc7cb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:08.322524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867fb08-5423-4ed8-a570-7c42e2e787d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:08.323412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867fb08-5423-4ed8-a570-7c42e2e787d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.323704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867fb08-5423-4ed8-a570-7c42e2e787d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.324193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867fb08-5423-4ed8-a570-7c42e2e787d6 None admin] PATH_INFO: `/v3/domains/default/users/98bd6a1dc7ae4125860c8750461c1fa5/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.326230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867fb08-5423-4ed8-a570-7c42e2e787d6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=98bd6a1dc7ae4125860c8750461c1fa5, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:08.327732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867fb08-5423-4ed8-a570-7c42e2e787d6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:08.347120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb44dad-f79e-4f91-a7e4-85a1cfe368b9 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:08.381897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:08.382555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.382836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.383109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.383817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:08.385379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:08.425828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 18/40] 10.222.0.45 () {58 vars in 1361 bytes} [Mon Jul 25 12:30:08 2022] PUT /identity/v3/domains/default/users/98bd6a1dc7ae4125860c8750461c1fa5/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:08.427376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07532-43b5-4ebc-949a-4681dbb75f29 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.427667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07532-43b5-4ebc-949a-4681dbb75f29 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.427959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca07532-43b5-4ebc-949a-4681dbb75f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.448401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dca07532-43b5-4ebc-949a-4681dbb75f29 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:08.449964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dca07532-43b5-4ebc-949a-4681dbb75f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:08.528334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 19/41] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:08.529868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.530290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.530710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.557921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:08.559047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:08.593387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:08.594136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 23/42] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:30:08 2022] POST /identity/v3/projects => generated 301 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:08.595181 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:08.640827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 20/43] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:08.672086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:08.698223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:08.725986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87203ac2-c9e7-45e0-8a8c-67a92c32f53c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:08.764993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fe9c9-1491-45ab-944b-397e264fc7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:08.765691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe9c9-1491-45ab-944b-397e264fc7ca None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.765975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe9c9-1491-45ab-944b-397e264fc7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.766255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fe9c9-1491-45ab-944b-397e264fc7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.767025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fe9c9-1491-45ab-944b-397e264fc7ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:08.770424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fe9c9-1491-45ab-944b-397e264fc7ca None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:08.809068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def039b3-ce09-4d6f-a57f-13777fb8341b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:08.849471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:08.850279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:08.850560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:08.850834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:08.852070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:08.853592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:08.855196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 21/44] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:08.860750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:08.884028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 24/45] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Jul 25 12:30:08 2022] POST /identity/v3/roles => generated 223 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:08.904076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:08.980345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab4512-9e25-4981-8343-61e7db69025f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:09.020036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77a9ac-68c0-40ef-bf91-a3433a4f31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:09.020709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a9ac-68c0-40ef-bf91-a3433a4f31b4 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:09.020990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a9ac-68c0-40ef-bf91-a3433a4f31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:09.021264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77a9ac-68c0-40ef-bf91-a3433a4f31b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:09.021988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a9ac-68c0-40ef-bf91-a3433a4f31b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:09.023524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77a9ac-68c0-40ef-bf91-a3433a4f31b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:09.147571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 22/46] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:30:08 2022] POST /identity/v3/projects => generated 312 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:30:10.461594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fbaa6-8ea6-4ee3-bc93-8121d2532c29 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:10.462145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fbaa6-8ea6-4ee3-bc93-8121d2532c29 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:10.462145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fbaa6-8ea6-4ee3-bc93-8121d2532c29 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:10.463547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 25/47] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:10.468777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:10.469174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:10.469350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:10.488349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:10.489584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:10.554146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 23/48] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:10.576701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fbaa6-8ea6-4ee3-bc93-8121d2532c29 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:10.680561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fbaa6-8ea6-4ee3-bc93-8121d2532c29 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:10.715553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:10.716308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:10.716597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:10.716874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:10.719490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:10.727844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:10.735590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:10.742822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:10.743811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:10.744864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:10.761482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:10.842677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d331ee-021b-45a0-99c9-1feaad05989f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:10.879590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:10.880277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:10.880560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:10.880834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:10.881578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:10.881883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:10.883266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:10.891216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 24/50] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:10.897530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:10.994438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743134b8-2340-43ed-9c0b-c899db126ff2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:11.027968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098ced5-a603-454b-9703-f620167c688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:11.028852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ced5-a603-454b-9703-f620167c688a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.029137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ced5-a603-454b-9703-f620167c688a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.029411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ced5-a603-454b-9703-f620167c688a None admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.030617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ced5-a603-454b-9703-f620167c688a None admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:11.032115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ced5-a603-454b-9703-f620167c688a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:11.033748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 27/51] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:10 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:11.039779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:11.117786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:11.139017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6ecb1-e1d7-4ea0-957d-7b39d5e500bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:11.155463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f6568-44fc-42e4-b45e-a00caf22bef6 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.155757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f6568-44fc-42e4-b45e-a00caf22bef6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.156089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f6568-44fc-42e4-b45e-a00caf22bef6 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.157465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 28/52] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:11.162539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.162906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.163197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.173182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:11.173978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.174265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.174542 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.176776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:11.178222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:11.179834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 25/53] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:11.181746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:11.183260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:11.185342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:11.241770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:11.252682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 29/54] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:11.274202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:11.285351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d90e4d-2136-4128-afe2-19dbda74d032 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:11.318688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:11.319560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.319849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.320162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.321001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.domain.id=default, user.id=98bd6a1dc7ae4125860c8750461c1fa5) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:11.321320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:11.322769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:11.328698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 26/55] 10.222.0.45 () {56 vars in 1322 bytes} [Mon Jul 25 12:30:11 2022] GET /identity/v3/role_assignments?user.id=98bd6a1dc7ae4125860c8750461c1fa5&scope.domain.id=default&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:11.375334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fe4e9-1451-41da-9051-8f49e05fa620 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:11.411761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03309213-8651-4280-ac40-631a3e1f3b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:11.412601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309213-8651-4280-ac40-631a3e1f3b98 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.412881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309213-8651-4280-ac40-631a3e1f3b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.413152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03309213-8651-4280-ac40-631a3e1f3b98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.414357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03309213-8651-4280-ac40-631a3e1f3b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:11.415827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03309213-8651-4280-ac40-631a3e1f3b98 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:11.417494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 30/56] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:11.423291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:11.437213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:11.530881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781536-0f9b-4092-a061-583117dbd612 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:11.564322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acebe3c-5e99-44a3-a7f1-1b7848c7a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:11.564978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acebe3c-5e99-44a3-a7f1-1b7848c7a7fb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:11.565288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acebe3c-5e99-44a3-a7f1-1b7848c7a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:11.565568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acebe3c-5e99-44a3-a7f1-1b7848c7a7fb None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:11.566298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acebe3c-5e99-44a3-a7f1-1b7848c7a7fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:11.567747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acebe3c-5e99-44a3-a7f1-1b7848c7a7fb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:11.670263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 27/57] 10.222.0.45 () {60 vars in 1140 bytes} [Mon Jul 25 12:30:11 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:13.639060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc51d1-355a-4823-9239-8e4fb5cca1d3 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:13.639578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc51d1-355a-4823-9239-8e4fb5cca1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:13.639684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc51d1-355a-4823-9239-8e4fb5cca1d3 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:13.641042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 31/58] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:13.646645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:13.647039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:13.647200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:13.664988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:13.666167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:13.723108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:13.732881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 28/59] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:13.756955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc51d1-355a-4823-9239-8e4fb5cca1d3 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:13.818362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:13.856931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc51d1-355a-4823-9239-8e4fb5cca1d3 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:13.891073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71130da-0fd1-4c05-ab61-49de4de7dfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:13.891823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71130da-0fd1-4c05-ab61-49de4de7dfff None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:13.892133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71130da-0fd1-4c05-ab61-49de4de7dfff None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:13.892413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71130da-0fd1-4c05-ab61-49de4de7dfff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:13.893843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71130da-0fd1-4c05-ab61-49de4de7dfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:13.895293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71130da-0fd1-4c05-ab61-49de4de7dfff None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:13.896921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 32/60] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:13.902292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:13.998766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d52fb-d8d8-4a8f-8cdd-bd224830b84b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:14.032091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e8658-0a15-447c-8efc-5ca26827d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:14.032793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e8658-0a15-447c-8efc-5ca26827d659 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:14.033050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e8658-0a15-447c-8efc-5ca26827d659 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:14.033312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e8658-0a15-447c-8efc-5ca26827d659 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:14.034373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e8658-0a15-447c-8efc-5ca26827d659 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:14.035829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e8658-0a15-447c-8efc-5ca26827d659 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:14.134488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 29/61] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:13 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:17.268961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aacb81-1a8e-4dfd-ad1e-52542facc995 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.270398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aacb81-1a8e-4dfd-ad1e-52542facc995 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.270896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aacb81-1a8e-4dfd-ad1e-52542facc995 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.272579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 33/62] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:17.278037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c25c-d142-42a0-830c-ee764d1649e5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.278442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c25c-d142-42a0-830c-ee764d1649e5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.278602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c25c-d142-42a0-830c-ee764d1649e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.300056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b323c25c-d142-42a0-830c-ee764d1649e5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:17.301255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b323c25c-d142-42a0-830c-ee764d1649e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:17.360463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:17.391576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 30/63] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:17.427299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aacb81-1a8e-4dfd-ad1e-52542facc995 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:17.488696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1976a-6d02-4d2e-ba42-38664ad3437d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.489362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1976a-6d02-4d2e-ba42-38664ad3437d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.489847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1976a-6d02-4d2e-ba42-38664ad3437d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.491438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 31/64] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:17.496955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf452bb-e43d-451c-a900-a92145d4cdc2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.497483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf452bb-e43d-451c-a900-a92145d4cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.497973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf452bb-e43d-451c-a900-a92145d4cdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.521489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8cf452bb-e43d-451c-a900-a92145d4cdc2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:17.522613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8cf452bb-e43d-451c-a900-a92145d4cdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:17.562404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aacb81-1a8e-4dfd-ad1e-52542facc995 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:17.592577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:17.599488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:17.600544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.600970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.601408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.606676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 32/65] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:17.608296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860c086-336d-4780-9f2d-8ac2dcf9e725 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.608789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860c086-336d-4780-9f2d-8ac2dcf9e725 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.609394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860c086-336d-4780-9f2d-8ac2dcf9e725 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.610987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 33/66] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:17.618565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:17.626950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:17.628068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:17.628845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:17.630933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.631381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.631967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.638341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 34/67] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:17.639191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:17.654027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:17.655603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:17.736653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 34/68] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:17.737986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:17.769457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fb2cc-cd5b-4f14-9520-d95d274b09a3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:17.782765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:17.813954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:17.815595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.816088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.816537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.828566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:17.837224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:17.838061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:17.838890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:17.841350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:17.842312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:17.851463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d1b97-a517-4706-9162-d8266c41d66b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:17.888306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:17.888968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.889259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.889538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.890289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:17.890588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:17.892006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156e26e-0b29-4a90-adad-5e0938b25b79 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:17.898695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:17.903963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 35/70] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:17.903963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a5113-3cbb-46db-8677-9b326fabb08b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.903963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a5113-3cbb-46db-8677-9b326fabb08b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:17.903963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a5113-3cbb-46db-8677-9b326fabb08b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:17.903963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 36/71] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:17.904331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a5113-3cbb-46db-8677-9b326fabb08b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:17.962241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac54ab-918e-4909-97ab-e90938a02ef1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:17.998397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:17.999225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:17.999874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.000192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.010569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.011099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:18.014273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a5113-3cbb-46db-8677-9b326fabb08b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:18.019810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:18.023054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 36/72] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:18.023808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.048000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.048588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.048874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.049859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.050624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:18.050932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.052362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4efb07-ceb9-4922-99d6-ebebd4bf4b20 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.060234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.063352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6927f0d-e81f-438b-9260-c8c56e8740f4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.063352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6927f0d-e81f-438b-9260-c8c56e8740f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.063352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6927f0d-e81f-438b-9260-c8c56e8740f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.079274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a6927f0d-e81f-438b-9260-c8c56e8740f4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:18.080535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a6927f0d-e81f-438b-9260-c8c56e8740f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:18.128576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efa26-48e9-4e42-889b-ebbe0f2cfddc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.138375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.147375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 38/74] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:18.160857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742781ab-33be-495b-bcfb-1c1c075201f3 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.160857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742781ab-33be-495b-bcfb-1c1c075201f3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.160857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742781ab-33be-495b-bcfb-1c1c075201f3 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.160857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 39/75] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:18.160857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742781ab-33be-495b-bcfb-1c1c075201f3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.168840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.169992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.170527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.171009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.172281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.173876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.175711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 37/76] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.176564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.249374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.259023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742781ab-33be-495b-bcfb-1c1c075201f3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.277660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d61d0-2fe7-450b-b31d-6e72cf06c23e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.292994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.293666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.293955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.294237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.294986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:18.295296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.296703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a132ac-5a04-420c-80f8-8d5e9b1a9c3f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.308037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 40/77] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.308037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.308037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.308037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.311806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.312714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.313004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.313287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.324611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:18.325812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:18.328563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.330033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.332476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 38/78] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.333241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.370687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.393036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 41/79] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:18.404120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.449188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96cdd3-b06a-4dd3-8b9c-2dedce6205c7 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.478866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.481639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.482434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.482724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.483004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.493651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:18.495431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9839d8-5655-4633-9247-12203edbfd06 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:18.501666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:18.503474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 39/80] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:18.504298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.531999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.532643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.532925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.533199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.598514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.599800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.601322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.604204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a10f0-1859-4f31-b865-cd39b2b501bf None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.638071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.638948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.639237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.639518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.640759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.642191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.644039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 40/81] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.644815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.685550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.703848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 42/82] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:18.704734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.748456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1ccf-64c3-4ed6-8a34-3002f2b83a17 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.781833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.782486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.782783 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.783133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.802913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d8ee-7f73-44d1-a29c-98804b6cb9ab None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.813597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.842262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.843062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.843348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.843629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.844840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.847171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.848892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 43/83] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.849678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.851680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.854221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.901868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:18.948309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06698b2-31ea-4256-8a15-3bc2f6084a80 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:18.951901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 41/84] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:18.952762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:18.983121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:18.984079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:18.984370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:18.984652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:18.985409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:18.985722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:18.987948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:18.996172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 44/85] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:18.997035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.017411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.056069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29231d7-bdd9-48c3-9e58-fb3ea88fd70d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.089350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.090001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.090283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.090568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.096671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbbca-4bc9-4774-88bd-b21f8915eb38 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.110028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.130818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.131684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.132023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.132309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.133542 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.134990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.136739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 45/86] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:19.137477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.160523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.162009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.221829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.239308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fddb8f-0810-4ac4-9f62-d5983e99d500 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.259962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:19.260708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.278367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.279451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.279948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.280422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.281671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.284896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.357440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab09bd-0116-4d10-9533-a101e2e69b25 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.379113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 46/88] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:19 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:19.379980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.397431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.398328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.398615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.398892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.400197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.403395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.405535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 43/89] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:19.406381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.445336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.446084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.513972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605b960-1248-468c-bf74-e05a6241c356 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.527559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a11e74-661d-48bd-ae55-e8886e8ddd28 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.554839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.555734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.556794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.556794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.558808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.561255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.563735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 47/90] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:19.567678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.569544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.570219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.570503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.570780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.571620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=98bd6a1dc7ae4125860c8750461c1fa5) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:19.571977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.573394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.583155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 44/91] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/role_assignments?user.id=98bd6a1dc7ae4125860c8750461c1fa5&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:19.584354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.728228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf4ac0-450c-48cb-9fcf-c034a1f2c802 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.739959 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.740572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:19.748235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe103bf4-4539-4acd-a1b3-00fe23e114d4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.776642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.777684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.778323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.778609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.780295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.782407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.785705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 48/92] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:19.786959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.792376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:19.793298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:19.793756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:19.794205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:19.795221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=18b68b87d49d46599bc930bb6a4763db) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:19.800252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:19.800252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:19.810803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 45/93] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/role_assignments?user.id=18b68b87d49d46599bc930bb6a4763db&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:19.812294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:19.926350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee0110-1286-446f-831e-85e512d3b563 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.969046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f3a99-dcdf-483c-ba09-875c8d461614 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:19.999668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:20.000448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:20.000734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:20.001010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:20.043318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:20.044031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:20.044318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:20.044600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:20.045456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] RBAC: Adding query filter params (role.id=4348185648f74543ae092c82e26979ee, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=18b68b87d49d46599bc930bb6a4763db) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:20.045772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:20.047264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:20.056710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 46/94] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/role_assignments?user.id=18b68b87d49d46599bc930bb6a4763db&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=4348185648f74543ae092c82e26979ee => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:20.076347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:20.120071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:20.121593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:20.230371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 49/95] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:20.236063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:20.264546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:20.352182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6b26a-c019-43de-bd20-c513054d5eff None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:20.393281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f341f-f73b-46a8-90e9-20b67a530be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:20.394193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f341f-f73b-46a8-90e9-20b67a530be8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:20.394478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f341f-f73b-46a8-90e9-20b67a530be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:20.394754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f341f-f73b-46a8-90e9-20b67a530be8 None admin] PATH_INFO: `/v3/projects/746c956398e849eb87ec9566c526929f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:20.395989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f341f-f73b-46a8-90e9-20b67a530be8 None admin] RBAC: Authorizing `identity:get_project(project_id=746c956398e849eb87ec9566c526929f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:20.397457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f341f-f73b-46a8-90e9-20b67a530be8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:20.399386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 47/96] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:20 2022] GET /identity/v3/projects/746c956398e849eb87ec9566c526929f => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:20.405039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:20.484077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:20.515078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55cdd9-bea7-4208-a0f5-67cb3fe81e0d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:20.568676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:20.569361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:20.569647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:20.569924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:20.570791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=746c956398e849eb87ec9566c526929f, user.id=18b68b87d49d46599bc930bb6a4763db) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:20.571110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:20.572605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d8d3-79d5-4a4e-833c-2b517e6cc5ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:20.585198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 50/97] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:20 2022] GET /identity/v3/role_assignments?user.id=18b68b87d49d46599bc930bb6a4763db&scope.project.id=746c956398e849eb87ec9566c526929f&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:22.347357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350c10-4ab6-4d81-8e39-4a6f0ebee8ce None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.347906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350c10-4ab6-4d81-8e39-4a6f0ebee8ce None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.347906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3350c10-4ab6-4d81-8e39-4a6f0ebee8ce None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.349588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 48/98] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:22.354748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.355609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.356089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.380932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:22.382408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:22.386664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2323a3-5aa4-42cd-be9b-18bb41bfe36c None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.387143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2323a3-5aa4-42cd-be9b-18bb41bfe36c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.387620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2323a3-5aa4-42cd-be9b-18bb41bfe36c None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.389217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 49/99] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:22.396384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbae8bb-cee8-4816-a417-e2c2f41a8a0c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.396955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbae8bb-cee8-4816-a417-e2c2f41a8a0c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.397433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbae8bb-cee8-4816-a417-e2c2f41a8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.422946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2bbae8bb-cee8-4816-a417-e2c2f41a8a0c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:22.425794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2bbae8bb-cee8-4816-a417-e2c2f41a8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:22.526703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 51/100] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:22.544331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 50/101] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:22.557871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:22.570503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a159-e3f8-4b02-ab64-84d26c89d554 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.572313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a159-e3f8-4b02-ab64-84d26c89d554 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.572812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5a159-e3f8-4b02-ab64-84d26c89d554 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.575532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 51/102] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:22.583083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5a159-e3f8-4b02-ab64-84d26c89d554 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:22.625368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:22.664178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:22.709625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87d88b-ffa6-4fdb-8846-0aa7c92fb37a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:22.719567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5a159-e3f8-4b02-ab64-84d26c89d554 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:22.764879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620234a-955f-4418-b1e8-bc4fb6f527e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:22.765716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84466695-34d9-45cc-a0a7-2e5a0e0895d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:22.766677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84466695-34d9-45cc-a0a7-2e5a0e0895d7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.768308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620234a-955f-4418-b1e8-bc4fb6f527e4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.768712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84466695-34d9-45cc-a0a7-2e5a0e0895d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.768886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620234a-955f-4418-b1e8-bc4fb6f527e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.769180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84466695-34d9-45cc-a0a7-2e5a0e0895d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.769466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620234a-955f-4418-b1e8-bc4fb6f527e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.780537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620234a-955f-4418-b1e8-bc4fb6f527e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:22.782277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84466695-34d9-45cc-a0a7-2e5a0e0895d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c620234a-955f-4418-b1e8-bc4fb6f527e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:22.789686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:22.790576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:22.791333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-84466695-34d9-45cc-a0a7-2e5a0e0895d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:22.791963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:22.792741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:22.793528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 52/103] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:22.794150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.794150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.794150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.796771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 52/104] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:22.803511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9ec2-5ca3-479a-9461-e8f1e80a63ea None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.804121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9ec2-5ca3-479a-9461-e8f1e80a63ea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.804592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f9ec2-5ca3-479a-9461-e8f1e80a63ea None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.806362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 53/105] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:22.807276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f9ec2-5ca3-479a-9461-e8f1e80a63ea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:22.817520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:22.818824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:22.898700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 53/106] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:22.899970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:22.917136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:22.937058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f9ec2-5ca3-479a-9461-e8f1e80a63ea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:22.972161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:22.981821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:22.982806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:22.983089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:22.983532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:22.985459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:22.985924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:22.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f320-6c54-4206-ad60-e223729d5280 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.001495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 54/107] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.005431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af538-018b-4551-8618-b6122bdccf88 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.005957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af538-018b-4551-8618-b6122bdccf88 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.006294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260af538-018b-4551-8618-b6122bdccf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.025733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3e0e-978f-4b43-ad34-5e689562d884 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.032512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-260af538-018b-4551-8618-b6122bdccf88 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:23.034900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-260af538-018b-4551-8618-b6122bdccf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:23.064840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.065777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.066210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.066659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.067907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:23.068385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.069937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.079496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 54/108] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.080896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.162276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 55/109] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:23.163446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af538-018b-4551-8618-b6122bdccf88 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.229759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.258164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ccb20e-4535-4697-aa70-00b184cba84a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.270374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260af538-018b-4551-8618-b6122bdccf88 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.293669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.298536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.299998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.300493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.300965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.308464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.309609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.310124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.310617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.312100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.312994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:23.313961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.321286 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 56/110] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.322373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:23.323374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:23.324257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 55/111] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:23.325412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.434465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04408-4a15-4d2b-a59e-c112c596dbaa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.435343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce8fe8-9fe2-46ba-b9eb-7297a59a168f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.468786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.469658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.469939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.470213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] PATH_INFO: `/v3/users/f7150fb752b8426ba07c656b03ed5e88` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.470308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.471834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.472139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.472416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.473815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.475281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.481612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 56/112] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.481612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.481612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.489124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] RBAC: Authorizing `identity:get_user(user_id=f7150fb752b8426ba07c656b03ed5e88)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.490604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.492994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 57/113] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/users/f7150fb752b8426ba07c656b03ed5e88 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.497777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.547451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.586239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3f013-da4e-4a60-a5dd-37a619826045 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.606512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3adeca-31c5-44a8-a8e6-a541b2a430f5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.621172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a01e6-14a0-4000-8a02-80ca62b5dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.622040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a01e6-14a0-4000-8a02-80ca62b5dadb None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.622325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a01e6-14a0-4000-8a02-80ca62b5dadb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.622598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a01e6-14a0-4000-8a02-80ca62b5dadb None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.623793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a01e6-14a0-4000-8a02-80ca62b5dadb None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.625278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a01e6-14a0-4000-8a02-80ca62b5dadb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.627185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 57/114] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.633245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c310-f26b-4c18-839a-ca65307778b6 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.633528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c310-f26b-4c18-839a-ca65307778b6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.633803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29c310-f26b-4c18-839a-ca65307778b6 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.635112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 58/115] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:23.635791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c310-f26b-4c18-839a-ca65307778b6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.654414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.655096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.655386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.655667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.656472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:23.656789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.658734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.667322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 58/116] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:23.668154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.714920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.746497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29c310-f26b-4c18-839a-ca65307778b6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.769675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6d72-eb99-40ab-99aa-b68da11151df None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.778414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.782229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.782976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.783889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.784305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.785009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.786467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.803482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1dd26-a0b1-49ca-bae5-a9bbf1c60e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:23.804184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1dd26-a0b1-49ca-bae5-a9bbf1c60e42 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.804474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1dd26-a0b1-49ca-bae5-a9bbf1c60e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.804775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1dd26-a0b1-49ca-bae5-a9bbf1c60e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:23.854234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 59/117] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:30:23 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:23.855114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:23.875432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1dd26-a0b1-49ca-bae5-a9bbf1c60e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:23.876983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1dd26-a0b1-49ca-bae5-a9bbf1c60e42 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:23.963146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee0432-9e1d-4f99-83f0-e4c0e75997b2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:23.989037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:23.994228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 59/118] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:23.996197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:23.996489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:23.996768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.002635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b320932-3824-4944-877c-acf574b19cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.003315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b320932-3824-4944-877c-acf574b19cb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.003601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b320932-3824-4944-877c-acf574b19cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.003866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b320932-3824-4944-877c-acf574b19cb0 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/18b68b87d49d46599bc930bb6a4763db/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.005982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b320932-3824-4944-877c-acf574b19cb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b4d6311007470cb1808231ad28bd3a, user_id=18b68b87d49d46599bc930bb6a4763db, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:24.007439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b320932-3824-4944-877c-acf574b19cb0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:24.017011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:24.018361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:24.020494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:24.082654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 60/119] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:23 2022] PUT /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/18b68b87d49d46599bc930bb6a4763db/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:24.084565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c4094-1b42-4f2f-b2cd-926535872076 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.085014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c4094-1b42-4f2f-b2cd-926535872076 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.085430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c4094-1b42-4f2f-b2cd-926535872076 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.086936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 61/120] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:24.091067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 60/121] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:24.091067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.092270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c4094-1b42-4f2f-b2cd-926535872076 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.227493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f224bc3-d055-42c4-964f-76fdfc17006f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.232392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c4094-1b42-4f2f-b2cd-926535872076 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.273309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a530f45-8c02-4be0-a35d-9130dcb87981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.274445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a530f45-8c02-4be0-a35d-9130dcb87981 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.274901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a530f45-8c02-4be0-a35d-9130dcb87981 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.275331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a530f45-8c02-4be0-a35d-9130dcb87981 None admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.276822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a530f45-8c02-4be0-a35d-9130dcb87981 None admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:24.277346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.278285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.278639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.278927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a530f45-8c02-4be0-a35d-9130dcb87981 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:24.279036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.280326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:24.281005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 61/122] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:24.281912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:24.282356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.282642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.282919 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.284446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 62/123] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:24.285340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.297290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:24.304982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:24.306484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:24.348770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:24.403317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 62/124] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:24.404215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.404870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349929-a9d2-435c-b8f8-037cc8224e4b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.448129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.448950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.449235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.449509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.463195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:24.474657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:24.475720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:24.476555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:24.477813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 63/125] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:24.478095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.529667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3972c-7af5-4eb0-a081-299de4e85937 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.568480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.569755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.570260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.570756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.572261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:24.573945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:24.576102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 63/126] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:24.577156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.582721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:24.606062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006e1aa-6c3d-4734-917a-cc1036db9350 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.621234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:24.651802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.652534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.653143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.653678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.654908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] RBAC: Adding query filter params (role.id=e504869f5436413e945eb0a95fdfd224, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=f7150fb752b8426ba07c656b03ed5e88) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:24.655376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:24.657865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:24.665968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 64/127] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/role_assignments?user.id=f7150fb752b8426ba07c656b03ed5e88&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=e504869f5436413e945eb0a95fdfd224 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:24.666997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.731382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1468-0bbe-4df7-a315-d2276ad9b743 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.793293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65915e-194c-44a4-8643-891d9f1d227c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:24.825346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.826363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.826757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.827144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.835118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:24.836085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:24.836928 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:24.837347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:24.838240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:24.838687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:24.840807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:24.845584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:24.854415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:24.855339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:24.856161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:24.858703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 64/128] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:24.859407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 65/129] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:24.859996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.864878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:24.930487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:24.958073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:25.023583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d0f7-788c-4f10-98e1-522b2905ca18 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.054313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b5816-06d8-4c50-9612-9447e3f77886 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.100856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.102173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.102668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.106194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/98bd6a1dc7ae4125860c8750461c1fa5/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.108342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b4d6311007470cb1808231ad28bd3a, user_id=98bd6a1dc7ae4125860c8750461c1fa5, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.110001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.123533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.124860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.125344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.125791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.126854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:25.129849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.129849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.138532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 66/130] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:25.139504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:25.210545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 65/131] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:24 2022] PUT /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/98bd6a1dc7ae4125860c8750461c1fa5/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:25.211398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:25.249188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:25.254505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd47f2b-60c6-485f-a532-009604206e73 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.292014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.292919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.293220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.293510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.294836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.296394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.298239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 67/132] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:25 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:25.304488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:25.416236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ee6c-4c66-44b7-b8c6-817ed37e4f2c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.454592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.456393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.456700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.456987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.458228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.459698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.461573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 68/133] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:25 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:25.467363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:25.490296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb879e76-8b74-49a2-a44e-c90eac46ceb3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.514103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:25.549493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:25.582652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199ec7e-157d-4a60-a429-88866d291d75 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.592644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.593551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.593832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.594108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.595364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.597558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.602026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 66/134] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:25 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:25.607129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:25.620733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.621650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.621927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.622211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/18b68b87d49d46599bc930bb6a4763db/roles/4348185648f74543ae092c82e26979ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.624728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b4d6311007470cb1808231ad28bd3a, user_id=18b68b87d49d46599bc930bb6a4763db, role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.626224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.698925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 69/135] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:25 2022] PUT /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/18b68b87d49d46599bc930bb6a4763db/roles/4348185648f74543ae092c82e26979ee => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:25.748743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3d30f-182a-47ba-9fa2-6c8007b0664e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.790612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f2305-8b6a-4a36-8724-bc80ab180bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.791562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2305-8b6a-4a36-8724-bc80ab180bfc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.791856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2305-8b6a-4a36-8724-bc80ab180bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.792170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2305-8b6a-4a36-8724-bc80ab180bfc None admin] PATH_INFO: `/v3/projects/746c956398e849eb87ec9566c526929f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.793470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f2305-8b6a-4a36-8724-bc80ab180bfc None admin] RBAC: Authorizing `identity:get_project(project_id=746c956398e849eb87ec9566c526929f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.795072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f2305-8b6a-4a36-8724-bc80ab180bfc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:25.796831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 67/136] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:25 2022] GET /identity/v3/projects/746c956398e849eb87ec9566c526929f => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:25.803152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:25.930871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:25.938737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ae068-d5d6-4da9-9955-14724d727901 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:25.980870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a104dc-4305-49ac-92e2-7bc74742fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:25.981777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a104dc-4305-49ac-92e2-7bc74742fe4f None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:25.982064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a104dc-4305-49ac-92e2-7bc74742fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:25.982350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a104dc-4305-49ac-92e2-7bc74742fe4f None admin] PATH_INFO: `/v3/projects/746c956398e849eb87ec9566c526929f/users/18b68b87d49d46599bc930bb6a4763db/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:25.989257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a104dc-4305-49ac-92e2-7bc74742fe4f None admin] RBAC: Authorizing `identity:create_grant(project_id=746c956398e849eb87ec9566c526929f, user_id=18b68b87d49d46599bc930bb6a4763db, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:25.990820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a104dc-4305-49ac-92e2-7bc74742fe4f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:26.076421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 70/137] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:25 2022] PUT /identity/v3/projects/746c956398e849eb87ec9566c526929f/users/18b68b87d49d46599bc930bb6a4763db/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:30:26.271834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afdf00-3908-4d18-b053-477cef19c3b7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:26.272229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afdf00-3908-4d18-b053-477cef19c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:26.272440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afdf00-3908-4d18-b053-477cef19c3b7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:26.274194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 68/138] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:26.279488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:26.279790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:26.280107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:26.304878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:26.306144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:26.396440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 71/139] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:26.420870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afdf00-3908-4d18-b053-477cef19c3b7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:26.508100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:26.563579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afdf00-3908-4d18-b053-477cef19c3b7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:26.607414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa36291-daf4-408a-a2c1-40d9c3605c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:26.608249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa36291-daf4-408a-a2c1-40d9c3605c13 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:26.608541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa36291-daf4-408a-a2c1-40d9c3605c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:26.608826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa36291-daf4-408a-a2c1-40d9c3605c13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:26.610030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa36291-daf4-408a-a2c1-40d9c3605c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:26.611985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa36291-daf4-408a-a2c1-40d9c3605c13 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:26.614059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 69/140] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:26.619903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:26.730250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:26.755052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854ef4c-a295-4fb3-a958-173e6a7cb108 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:26.788352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762d7-abcc-45f4-b865-d949e6919b73 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:26.788663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762d7-abcc-45f4-b865-d949e6919b73 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:26.788935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762d7-abcc-45f4-b865-d949e6919b73 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:26.790393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 70/141] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:26.799878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:26.800416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:26.800821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:26.801840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:26.802519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:26.802805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:26.803080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:26.803802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:26.805261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:26.835909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:26.837141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:26.931350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 72/142] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:26 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:26.931695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 71/143] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:26.996184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:27.138594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241c252-e807-497e-9ccb-7914f2fa7dea None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:27.183279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:27.184151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:27.184451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:27.184730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:27.197049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:27.200990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:27.209731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:27.210890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:27.212007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 73/144] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:27.218817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:27.324218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:27.370559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4741d2-c522-44f2-80a5-6a581c7bb2cc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:27.406978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:27.407656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:27.408086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:27.408610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:27.409452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:27.409761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:27.411221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:27.420254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 72/145] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:27.426403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:27.546108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e8b29-327b-4052-8c9e-f6285dd6ddaa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:27.591339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a179e76-6e57-43ec-b4a4-8b422fa8658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:27.592262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a179e76-6e57-43ec-b4a4-8b422fa8658a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:27.592600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a179e76-6e57-43ec-b4a4-8b422fa8658a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:27.592922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a179e76-6e57-43ec-b4a4-8b422fa8658a None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:27.594174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a179e76-6e57-43ec-b4a4-8b422fa8658a None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:27.596251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a179e76-6e57-43ec-b4a4-8b422fa8658a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:27.597903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 74/146] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:27 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:27.603466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:27.714737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301740-3f07-4f32-8a93-c9a7ac53bdd1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:27.740365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:27.750769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:27.755764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:27.755764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:27.755764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:27.779855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9eba-b65f-4ddd-88c4-b6b4576872f4 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:27.780854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9eba-b65f-4ddd-88c4-b6b4576872f4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:27.781347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9eba-b65f-4ddd-88c4-b6b4576872f4 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:27.783538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 75/147] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:27.789696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:27.790288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:27.790776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:27.825861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:27.827560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:27.830829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:27.832332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:27.932682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 73/148] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:27.938079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:27.966071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.015729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.024388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 76/149] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:28.047616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85cd5f-4a15-4766-803c-1e7ffe6c70ff None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.059590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.085109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:28.086025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.086306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.086576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.087825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:28.089325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:28.091064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 74/150] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:27 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:28.097668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.202693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.216959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31781d5-a887-4385-a664-c6dfd0a9e1c4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.257162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:28.257827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.258109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.258385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.260108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=18b68b87d49d46599bc930bb6a4763db) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:28.260431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:28.261893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ccc16-f591-45f8-a790-36c9fbaa8ad2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:28.269565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 75/151] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/role_assignments?user.id=18b68b87d49d46599bc930bb6a4763db&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:28.319704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d7be-9bea-4504-8616-ac556136c609 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.320004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d7be-9bea-4504-8616-ac556136c609 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.320289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815d7be-9bea-4504-8616-ac556136c609 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.321672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 76/152] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:28.326640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a69ed8-7741-45b0-b171-808c012707f3 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.333677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.333962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.334244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.359202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:28.360823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:28.397137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:28.398213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.398642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.399061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.426874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:28.435099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:28.436080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:28.436874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:28.449160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 77/153] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:28.451665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.479574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 77/154] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:28.529979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.532630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.631864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dc065-8f0a-4b51-900a-a660c5b071c6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.636302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.655468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42d0f-69f3-4e95-9505-9a873dd56460 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.695957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:28.695957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.695957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.696246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.708935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:28.717783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:28.718780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:28.719568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 78/155] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:28.725367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:28.725541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.726500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.727006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.727482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.728497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:28.729888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:28.731526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:28.755679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 78/156] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:28.761529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.841026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be83e-6a3f-46d9-8263-2035d190f874 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.877472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:28.878420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:28.878889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:28.879310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:28.880243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:28.880709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:28.882246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:28.896222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 79/157] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:28.898458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:28.902880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.942099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eba45d-e868-4725-b033-2fe617d73034 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:28.978256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:28.999253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:29.000300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.000590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.000890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] PATH_INFO: `/v3/users/f7150fb752b8426ba07c656b03ed5e88` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.004588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] RBAC: Authorizing `identity:get_user(user_id=f7150fb752b8426ba07c656b03ed5e88)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:29.006157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:29.007876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0bb7f-b6b9-48d2-b8d7-e75e86971004 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:29.008301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 79/158] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/users/f7150fb752b8426ba07c656b03ed5e88 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:29.013644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:29.044714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:29.045861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.046309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.046746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] PATH_INFO: `/v3/users/98bd6a1dc7ae4125860c8750461c1fa5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.048140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=98bd6a1dc7ae4125860c8750461c1fa5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:29.049786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:29.051894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 80/159] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:28 2022] GET /identity/v3/users/98bd6a1dc7ae4125860c8750461c1fa5 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:29.057581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:29.166814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:29.181798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2e42f-5d05-46b8-9ff0-d392a4076bae None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:29.220800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc084c-02c3-4d90-9ffa-5d97842eb0f0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:29.245294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:29.246451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.246884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.247305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.248813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:29.250476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:29.254202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 80/160] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:29 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:29.260520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:29.288991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0496d-8cf3-4a42-9ce0-4a0679e35cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:29.289892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0496d-8cf3-4a42-9ce0-4a0679e35cba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.290334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0496d-8cf3-4a42-9ce0-4a0679e35cba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.290780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0496d-8cf3-4a42-9ce0-4a0679e35cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.363158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:29.454572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0496d-8cf3-4a42-9ce0-4a0679e35cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:29.456427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0496d-8cf3-4a42-9ce0-4a0679e35cba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:29.457982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fb79-ed60-481e-b9a0-021f0f176c65 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:29.552733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4f0a-1e15-4eca-bd6b-8a62043a7929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:29.553562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4f0a-1e15-4eca-bd6b-8a62043a7929 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.553840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4f0a-1e15-4eca-bd6b-8a62043a7929 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.554111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4f0a-1e15-4eca-bd6b-8a62043a7929 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/f7150fb752b8426ba07c656b03ed5e88/roles/e504869f5436413e945eb0a95fdfd224` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.560743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4f0a-1e15-4eca-bd6b-8a62043a7929 None admin] RBAC: Authorizing `identity:create_grant(project_id=33b4d6311007470cb1808231ad28bd3a, user_id=f7150fb752b8426ba07c656b03ed5e88, role_id=e504869f5436413e945eb0a95fdfd224)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:29.562216 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4f0a-1e15-4eca-bd6b-8a62043a7929 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:29.596817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:29.629550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 81/161] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:29.631038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf5cc-f72f-4f60-a54d-9af39da2da8e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.631333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf5cc-f72f-4f60-a54d-9af39da2da8e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.631610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cf5cc-f72f-4f60-a54d-9af39da2da8e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.633809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 82/162] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:29.635132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a4a3-4c7a-492e-abbf-a4decf6de88f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.636002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a4a3-4c7a-492e-abbf-a4decf6de88f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.636002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1a4a3-4c7a-492e-abbf-a4decf6de88f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.636965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 83/163] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:29.640758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a4a3-4c7a-492e-abbf-a4decf6de88f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:29.655326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 81/164] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:29 2022] PUT /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a/users/f7150fb752b8426ba07c656b03ed5e88/roles/e504869f5436413e945eb0a95fdfd224 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:29.661839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.663459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.664013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.707281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:29.708557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:29.808754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1a4a3-4c7a-492e-abbf-a4decf6de88f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:29.861195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38eccb-d1e9-46d0-a4b9-3ea054ff62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:29.862187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38eccb-d1e9-46d0-a4b9-3ea054ff62e7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.862469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38eccb-d1e9-46d0-a4b9-3ea054ff62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.862744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38eccb-d1e9-46d0-a4b9-3ea054ff62e7 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.865013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38eccb-d1e9-46d0-a4b9-3ea054ff62e7 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:29.866755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38eccb-d1e9-46d0-a4b9-3ea054ff62e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:29.869240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 84/165] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:29 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:29.870737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02f792-855f-4421-b415-3889608cf05a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:29.871026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02f792-855f-4421-b415-3889608cf05a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:29.871304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02f792-855f-4421-b415-3889608cf05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:29.904347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dc02f792-855f-4421-b415-3889608cf05a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:29.905877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dc02f792-855f-4421-b415-3889608cf05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:29.976341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:30.016529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 85/166] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:30.017408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02f792-855f-4421-b415-3889608cf05a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.082150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 82/167] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:30.101022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.154964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02f792-855f-4421-b415-3889608cf05a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:30.198869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:30.199534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:30.199820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:30.200120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:30.200963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=98bd6a1dc7ae4125860c8750461c1fa5) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:30.201280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:30.202740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:30.219011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 86/168] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/role_assignments?user.id=98bd6a1dc7ae4125860c8750461c1fa5&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:30.219786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.269225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:30.280351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:30.382202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b3b8-61a3-48a7-b26f-fc1213fea8a9 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:30.387941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65342825-aa24-42f5-b767-34b4f8da1077 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:30.446761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:30.447358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:30.448205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:30.448505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:30.448861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:30.448962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:30.449139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:30.449594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:30.467671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:30.481001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:30.481884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:30.482772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:30.483611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:30.487224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 83/169] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:30.492705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:30.495744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:30.496673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:30.497475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 87/170] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:30.503196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.612934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4977fed-e74d-4376-8c41-380a63cccda9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:30.620930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:30.707652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:30.708380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:30.708666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:30.708948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:30.709719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:30.710026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:30.711431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:30.732280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:30.738647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 84/171] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:30.744139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.750063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca8955-a40b-462a-a2b3-661a1efef964 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:30.832631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:30.833310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:30.833587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:30.833856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:30.834613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:30.834922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:30.836347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:30.854127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 88/172] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:30.859570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:30.978252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5cfb3-ed9c-4408-8c14-a8be82a3a861 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.034807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dad38-bc85-42e1-a600-7cad82a6f874 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.045180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.046082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.048441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.048441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.056768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.058265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.060013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 85/173] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:31.066203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:31.103146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.104068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.104348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.104618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] PATH_INFO: `/v3/users/18b68b87d49d46599bc930bb6a4763db` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.108646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] RBAC: Authorizing `identity:get_user(user_id=18b68b87d49d46599bc930bb6a4763db)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.110244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.112803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 89/174] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:30 2022] GET /identity/v3/users/18b68b87d49d46599bc930bb6a4763db => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:31.118376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:31.128630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.171527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.197708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b71d-6692-41f0-9bf1-037575fa525c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.239480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b9af-273c-4ffb-ad77-483cec93dc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.240168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b9af-273c-4ffb-ad77-483cec93dc6d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.240454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b9af-273c-4ffb-ad77-483cec93dc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.240732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b9af-273c-4ffb-ad77-483cec93dc6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.317726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ecf3f-385f-478e-84fa-71db880b1754 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.353504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3b9af-273c-4ffb-ad77-483cec93dc6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.354993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3b9af-273c-4ffb-ad77-483cec93dc6d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.375406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf02343-efaf-478b-8afa-2e8ca658c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.376100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02343-efaf-478b-8afa-2e8ca658c02e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.376945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02343-efaf-478b-8afa-2e8ca658c02e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.377221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02343-efaf-478b-8afa-2e8ca658c02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.429237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.486662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf02343-efaf-478b-8afa-2e8ca658c02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.488549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf02343-efaf-478b-8afa-2e8ca658c02e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.514121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.516426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 86/175] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:31.517746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a6a99-8b5d-4e74-94ae-01623cd7668a None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.518220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a6a99-8b5d-4e74-94ae-01623cd7668a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.518497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a6a99-8b5d-4e74-94ae-01623cd7668a None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.519781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 87/176] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:31.523224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89776-eb6d-4f93-9af2-c8d5adf2c810 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.523224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89776-eb6d-4f93-9af2-c8d5adf2c810 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.523224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a89776-eb6d-4f93-9af2-c8d5adf2c810 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.523224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 88/177] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:31.523832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a89776-eb6d-4f93-9af2-c8d5adf2c810 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:31.601955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 90/178] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:31.603276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.603553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.603834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.622439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:31.623636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:31.643701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a89776-eb6d-4f93-9af2-c8d5adf2c810 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.681632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613a61a-d697-4779-8675-b59ecd43363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.682494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613a61a-d697-4779-8675-b59ecd43363e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.682767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613a61a-d697-4779-8675-b59ecd43363e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.683195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613a61a-d697-4779-8675-b59ecd43363e None admin] PATH_INFO: `/v3/projects/746c956398e849eb87ec9566c526929f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.684811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613a61a-d697-4779-8675-b59ecd43363e None admin] RBAC: Authorizing `identity:get_project(project_id=746c956398e849eb87ec9566c526929f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.686295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613a61a-d697-4779-8675-b59ecd43363e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.688704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 89/179] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:31 2022] GET /identity/v3/projects/746c956398e849eb87ec9566c526929f => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:31.690816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254cc1e-e46e-4961-a5db-f143858c1a9f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.691099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254cc1e-e46e-4961-a5db-f143858c1a9f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.691473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254cc1e-e46e-4961-a5db-f143858c1a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.696380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 91/180] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:31.697216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:31.699812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.719184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9254cc1e-e46e-4961-a5db-f143858c1a9f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:31.720509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9254cc1e-e46e-4961-a5db-f143858c1a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:31.754530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.797161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 90/181] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:31.799002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a7d3-dfd4-4510-8027-eee03d63f640 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.799294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a7d3-dfd4-4510-8027-eee03d63f640 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.799576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a7d3-dfd4-4510-8027-eee03d63f640 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.801088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 91/182] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:31.801605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a7d3-dfd4-4510-8027-eee03d63f640 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:31.810394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6af7e-c155-46a4-825b-4fa244db3c7b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.849398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.850263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.850544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.850818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.852033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.853494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.860073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 92/183] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:31 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:31.860073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:31.924721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a7d3-dfd4-4510-8027-eee03d63f640 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.961517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:31.962171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.962455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.962725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.963547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=746c956398e849eb87ec9566c526929f, user.id=18b68b87d49d46599bc930bb6a4763db) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:31.963860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:31.965326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85c1cd-8008-4504-995e-dbbe6e6854e6 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:31.967135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:31.971371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c7418-24d1-4f8f-aa69-6107f51ecad9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:31.971590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 92/184] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:31 2022] GET /identity/v3/role_assignments?user.id=18b68b87d49d46599bc930bb6a4763db&scope.project.id=746c956398e849eb87ec9566c526929f&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:31.972907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:31.973199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:31.973475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:31.993179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:31.995010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:32.014782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:32.032127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.033610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.034088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.034556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.036254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.038894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.041276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 93/185] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:32.042397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.081414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 93/186] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:32.082371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.174868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285a72-bb3e-40cf-82cb-50bcfe8775d7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.199007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55917a1-d315-4f26-922f-4f11dd628db8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.211706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.212590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.212873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.213144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.228947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:32.236998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:32.237902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:32.238699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 94/187] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:32.239358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.240825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:32.250259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.251791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.252371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.252887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.254033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] RBAC: Adding query filter params (role.id=4348185648f74543ae092c82e26979ee, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=18b68b87d49d46599bc930bb6a4763db) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:32.254530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.256358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.263451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 94/188] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/role_assignments?user.id=18b68b87d49d46599bc930bb6a4763db&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=4348185648f74543ae092c82e26979ee => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:32.264629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.301321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:32.362766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec26d8-7adf-4218-a12d-0fcf6e657c44 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.397538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871dc21-b872-4b59-a418-a4831f93f8ad None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.404260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.404952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.405339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.405628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.406361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.408357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.437189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.438018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.438336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.438665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.452971 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:32.461835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:32.463736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 95/189] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:32.464922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.522147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 95/190] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:32 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:32.523461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.530069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:32.598142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b811b6c-92ee-42a4-b52a-1e01b6cadbe3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.639624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.640460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.640855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.641284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.642807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:32.643490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.645267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.654729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 96/191] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:32.655256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb2725-e8cb-4914-bb4d-8d35198ac68f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.663779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:32.665068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.703322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.704043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.704952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.705224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.706202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:32.711352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.711352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.721792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 96/192] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:32.728062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.822004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65e04-e26f-4297-9b88-93577a83c2cf None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.843105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:32.890958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba263bb6-3410-46cf-b982-896a45afbf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.891377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba263bb6-3410-46cf-b982-896a45afbf9f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.891759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba263bb6-3410-46cf-b982-896a45afbf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.892239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba263bb6-3410-46cf-b982-896a45afbf9f None admin] PATH_INFO: `/v3/users/e8c544a40b7e46f194e94bb220815878` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.914497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba263bb6-3410-46cf-b982-896a45afbf9f None admin] RBAC: Authorizing `identity:get_user(user_id=e8c544a40b7e46f194e94bb220815878)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.916353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba263bb6-3410-46cf-b982-896a45afbf9f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.922490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 97/193] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/users/e8c544a40b7e46f194e94bb220815878 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:32.927030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172752ff-a994-4b43-9ca3-dd71eff03ae4 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.927321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172752ff-a994-4b43-9ca3-dd71eff03ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.928255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172752ff-a994-4b43-9ca3-dd71eff03ae4 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.929415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 98/194] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:32.930147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172752ff-a994-4b43-9ca3-dd71eff03ae4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:32.935541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c73ab-09a9-4137-ad70-8a2cf54787ae None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:32.986724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8525ff9-70ee-4a24-a99f-ab37b6853507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:32.987995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8525ff9-70ee-4a24-a99f-ab37b6853507 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:32.989289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8525ff9-70ee-4a24-a99f-ab37b6853507 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:32.989759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8525ff9-70ee-4a24-a99f-ab37b6853507 None admin] PATH_INFO: `/v3/users/e8c544a40b7e46f194e94bb220815878` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:32.991189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8525ff9-70ee-4a24-a99f-ab37b6853507 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c544a40b7e46f194e94bb220815878)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:32.993593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8525ff9-70ee-4a24-a99f-ab37b6853507 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:32.996305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 97/195] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/users/e8c544a40b7e46f194e94bb220815878 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:33.000006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.003713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.006273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.049566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:33.051677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:33.112694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.125840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172752ff-a994-4b43-9ca3-dd71eff03ae4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.186091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 98/196] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:33.188116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.189432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.190087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.190366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.190638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.250180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.278990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:33.280695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:33.339898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c3323-b187-4b4f-9914-954e1348c893 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.378857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.379606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.380096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.380449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.400612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 99/197] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:33.401995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.417085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.457524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:33.458953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:33.491041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.529836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cc559-f5d0-40f2-be20-2af625b4c07e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.568806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.570104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.570667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.571144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.581378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 99/198] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:33.582570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.583094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:33.591178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:33.592121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:33.592947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:33.595582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 100/199] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:33.596686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.688346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.704962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b590a-4506-49c5-9cac-bfd967925623 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.720617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe69e5-7d8f-45b2-930e-ccb697ffdc9c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.752988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.753156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.753953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.754320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.754512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.756437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:33.758821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:33.760741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 100/200] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:33.761324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.763603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.772072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.772072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.772072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.772072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:33.772072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:33.772669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 101/201] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:33.774137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.869060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0eafc-9e00-4447-99d0-d214283b8b29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.878398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43582-0316-4ab0-9c2f-65f207d5d0c6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:33.905579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.906283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.906576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.906853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.907647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:33.907983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:33.909589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:33.912037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:33.913237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:33.913939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:33.914229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:33.914511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:33.915359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=e8c544a40b7e46f194e94bb220815878) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:33.915681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:33.917190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:33.918565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 101/202] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:33.919727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:33.932823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 102/203] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/role_assignments?user.id=e8c544a40b7e46f194e94bb220815878&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:33.935558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:34.037498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe96ea-42c2-40ac-9a10-af787b9e8c3f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:34.065164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:34.078041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:34.078714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:34.079000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:34.079354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:34.080653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] RBAC: Adding query filter params (role.id=4348185648f74543ae092c82e26979ee, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=e8c544a40b7e46f194e94bb220815878) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:34.080978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:34.082488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:34.090929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 102/204] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/role_assignments?user.id=e8c544a40b7e46f194e94bb220815878&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=4348185648f74543ae092c82e26979ee => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:34.122573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4cbce-63ae-42b5-8c50-9837e25391a4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:34.162739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:34.486460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:34.486460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:34.486460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] PATH_INFO: `/v3/users/f7150fb752b8426ba07c656b03ed5e88` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:34.486460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] RBAC: Authorizing `identity:get_user(user_id=f7150fb752b8426ba07c656b03ed5e88)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:34.486460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:34.486460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 103/205] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:33 2022] GET /identity/v3/users/f7150fb752b8426ba07c656b03ed5e88 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:34.487337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:34.487337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:34.487337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d2920-ade6-44f5-826f-1f3db11acc39 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:34.487337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:34.487633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:34.487633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:34.487633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:34.487633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:34.487633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:34.526735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 103/206] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:34.533870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:34.534112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:34.706376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092d32-40dd-441f-bee4-999e0a5ac473 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:34.747187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:34.756913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d394e6b-2452-42b2-a37e-7c17d7be6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:34.758078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394e6b-2452-42b2-a37e-7c17d7be6b26 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:34.758580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394e6b-2452-42b2-a37e-7c17d7be6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:34.759068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394e6b-2452-42b2-a37e-7c17d7be6b26 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:34.764637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394e6b-2452-42b2-a37e-7c17d7be6b26 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:34.771096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394e6b-2452-42b2-a37e-7c17d7be6b26 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:34.771096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 104/207] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:34 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:34.774930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:34.932054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4451a-a87c-4c64-8f87-7f4123de8ad6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:34.980810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:34.981560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:34.981841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:34.982168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:34.983012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] RBAC: Adding query filter params (role.id=e504869f5436413e945eb0a95fdfd224, scope.project.id=33b4d6311007470cb1808231ad28bd3a, user.id=f7150fb752b8426ba07c656b03ed5e88) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:34.983325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:34.984794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa06aba-3eef-4b84-8391-f2c06eeaa251 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:34.991995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 104/208] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:34 2022] GET /identity/v3/role_assignments?user.id=f7150fb752b8426ba07c656b03ed5e88&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=e504869f5436413e945eb0a95fdfd224 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:35.026270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8f46-5d75-4ab4-adcb-7795907e446a None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.026466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8f46-5d75-4ab4-adcb-7795907e446a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.026742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b8f46-5d75-4ab4-adcb-7795907e446a None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.028264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 105/209] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:35.034144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dfc49-9918-4aa5-b820-856f3bf5d4db None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.040141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dfc49-9918-4aa5-b820-856f3bf5d4db None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.040141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dfc49-9918-4aa5-b820-856f3bf5d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.055136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-367dfc49-9918-4aa5-b820-856f3bf5d4db None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:35.056391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-367dfc49-9918-4aa5-b820-856f3bf5d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:35.076567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:35.136890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 105/210] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:35.151282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09cda-3cb2-4ab9-bb9c-736b37917b86 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.151623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09cda-3cb2-4ab9-bb9c-736b37917b86 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.151854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f09cda-3cb2-4ab9-bb9c-736b37917b86 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.153537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 106/211] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:35.160197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.160478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.160749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.179538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09cda-3cb2-4ab9-bb9c-736b37917b86 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:35.180056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:35.181423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:35.294134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 106/212] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:35.330457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f09cda-3cb2-4ab9-bb9c-736b37917b86 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:35.334361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:35.373845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:35.374658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.374939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.375269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.387038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:35.396379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:35.397345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:35.398188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 107/213] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:35.404405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:35.443810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:35.466122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d4b43-f694-4e01-ade5-bc440d749775 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:35.472283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:35.511863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:35.513407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.513851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.514531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.516084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:35.518724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:35.519531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d626ffa-ae79-4ec0-ad59-09f9fccae64b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:35.522336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 107/214] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:35.527959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:35.567168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:35.568239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.568744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.569232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.570185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:35.570712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:35.572338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:35.582105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 108/215] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:35.588576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:35.639060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa89f2-47af-467f-82ed-d2a60d8ff75f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:35.675109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:35.675781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.676098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.676375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.677092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:35.678541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:35.716904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51787459-2794-48af-8172-3519ebe6cf8c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:35.741981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:35.753604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:35.754454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.754730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.755005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] PATH_INFO: `/v3/users/95a9817c04714b55bbecd6cc428f723c` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.768776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=95a9817c04714b55bbecd6cc428f723c)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:35.770262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:35.772163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 109/216] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:35 2022] GET /identity/v3/users/95a9817c04714b55bbecd6cc428f723c => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:35.777268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:35.790484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 108/217] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:35 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:35.903101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fe3d7-151d-4a7a-9dfd-bb48d4b58fe1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:35.942579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:35.943246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:35.943588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:35.943939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:35.996458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:36.016049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:36.017777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:36.130947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 110/218] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:36.136665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:36.149786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:36.259870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c26ce4-253a-4c8f-b716-3330531e45a8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:36.312915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6149bf-7cff-49a5-95d6-a20bed46144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:36.314363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6149bf-7cff-49a5-95d6-a20bed46144c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.314708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6149bf-7cff-49a5-95d6-a20bed46144c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.315017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6149bf-7cff-49a5-95d6-a20bed46144c None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.320673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6149bf-7cff-49a5-95d6-a20bed46144c None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:36.322144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6149bf-7cff-49a5-95d6-a20bed46144c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:36.324226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 109/219] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:36 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:36.331005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:36.388170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c70a-3c38-4281-b9ac-346ce1b96e0c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.388510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c70a-3c38-4281-b9ac-346ce1b96e0c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.388734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2c70a-3c38-4281-b9ac-346ce1b96e0c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.390698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 110/220] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:36.405693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.405972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.406255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.435865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:36.437099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:36.465696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:36.489334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b1a6-2027-410c-b200-8313c047e10d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:36.527053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:36.527673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.527905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.528208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.529110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=95a9817c04714b55bbecd6cc428f723c) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:36.529428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:36.530891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abc63b-4768-4d49-8ef3-a294b451796e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:36.537688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 111/221] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:36 2022] GET /identity/v3/role_assignments?user.id=95a9817c04714b55bbecd6cc428f723c&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:36.570449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 111/222] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:36.600721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947409d-b2a9-4ee5-9d0c-d2e6321c4617 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.601040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947409d-b2a9-4ee5-9d0c-d2e6321c4617 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.601283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947409d-b2a9-4ee5-9d0c-d2e6321c4617 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.602754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 112/223] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:36.608290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:36.613077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b724723-b016-4323-b331-3093a1862e84 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.613265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b724723-b016-4323-b331-3093a1862e84 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.613478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b724723-b016-4323-b331-3093a1862e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.628126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:36.649360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5b724723-b016-4323-b331-3093a1862e84 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:36.650610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5b724723-b016-4323-b331-3093a1862e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:36.769146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef4de-2db5-498e-97c3-105871018ae5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:36.777484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 113/224] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:36.802930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b724723-b016-4323-b331-3093a1862e84 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:36.836596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:36.838778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:36.839446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:36.840976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:36.862622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:36.879975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:36.880906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:36.881700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:36.884469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 112/225] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:36.890428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:36.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:37.001892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b724723-b016-4323-b331-3093a1862e84 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.026354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:37.048500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078269e-fdc4-4308-9982-bbe21ca4a84e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.081264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.082263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.082765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.084058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.084229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:37.084637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.086240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.096727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 113/226] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:37.103785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.105507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.106500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.107265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.109299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.131184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:37.139389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:37.140287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:37.141103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:37.143102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 114/227] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:37.152839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.234546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b639cb-3e99-4842-89f7-0de5f42e52fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.265109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:37.276262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.277481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.278325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.278774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] PATH_INFO: `/v3/users/e8c544a40b7e46f194e94bb220815878` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.284736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] RBAC: Authorizing `identity:get_user(user_id=e8c544a40b7e46f194e94bb220815878)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.286409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.289243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 114/228] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:37 2022] GET /identity/v3/users/e8c544a40b7e46f194e94bb220815878 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:37.294806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.365499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498c6e8-03f2-4c21-b5e2-f5a5a0cb958c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.404581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.405546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.406025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.406634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.408679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:37.409168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.410745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.412995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:37.422266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 115/229] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:37.430285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.537984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493dca0-8c7f-47f2-9b0f-d0f09a7220e4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.553483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda02bd3-fa57-4243-ad0b-ee2c905f5ccc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.573657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.574824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.575313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.575831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] PATH_INFO: `/v3/users/e8c544a40b7e46f194e94bb220815878` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.577291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c544a40b7e46f194e94bb220815878)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.579035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.580992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 116/230] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:37 2022] GET /identity/v3/users/e8c544a40b7e46f194e94bb220815878 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:37.586364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.627940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.629100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.629633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.630110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.631729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.633470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.636658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 115/231] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:37 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:37.642417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.709397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:37.771950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:37.785135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5be6e-dd7f-4107-a128-02e1b80aebf6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.837486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a41583-f06c-45d9-a1c0-ecf2cc853942 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:37.853382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.854259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.854539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.854811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.856627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.858527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.863047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 117/232] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:37 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:37.866713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:37.903991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd48e13-b477-4ac6-86cd-c94788c6cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:37.905323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd48e13-b477-4ac6-86cd-c94788c6cdea None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:37.905830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd48e13-b477-4ac6-86cd-c94788c6cdea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:37.906343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd48e13-b477-4ac6-86cd-c94788c6cdea None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1/users/e8c544a40b7e46f194e94bb220815878/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:37.909156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd48e13-b477-4ac6-86cd-c94788c6cdea None admin] RBAC: Authorizing `identity:create_grant(project_id=719541d70431436ca6b3d21f00624cc1, user_id=e8c544a40b7e46f194e94bb220815878, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:37.915567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd48e13-b477-4ac6-86cd-c94788c6cdea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:37.979704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101f7cd-9d4c-4b61-9961-e98c46f2cc4c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:38.012227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:38.023958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e013b3-eee6-42e3-8b0d-07b20d38400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:38.023958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e013b3-eee6-42e3-8b0d-07b20d38400e None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:38.023958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e013b3-eee6-42e3-8b0d-07b20d38400e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:38.023958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e013b3-eee6-42e3-8b0d-07b20d38400e None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1/users/e8c544a40b7e46f194e94bb220815878/roles/4348185648f74543ae092c82e26979ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:38.024339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e013b3-eee6-42e3-8b0d-07b20d38400e None admin] RBAC: Authorizing `identity:create_grant(project_id=719541d70431436ca6b3d21f00624cc1, user_id=e8c544a40b7e46f194e94bb220815878, role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:38.024339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e013b3-eee6-42e3-8b0d-07b20d38400e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:38.025298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 116/233] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:37 2022] PUT /identity/v3/projects/719541d70431436ca6b3d21f00624cc1/users/e8c544a40b7e46f194e94bb220815878/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:38.145007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 118/234] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:37 2022] PUT /identity/v3/projects/719541d70431436ca6b3d21f00624cc1/users/e8c544a40b7e46f194e94bb220815878/roles/4348185648f74543ae092c82e26979ee => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:30:38.461819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f226-b9ba-408a-a062-c25af79b7b9d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:38.461819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f226-b9ba-408a-a062-c25af79b7b9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:38.461819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f226-b9ba-408a-a062-c25af79b7b9d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:38.465320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 117/235] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:38.467053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:38.467560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:38.468055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:38.475642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb771f2-ed2a-48c0-bd95-23b401c6c98c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:38.475642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb771f2-ed2a-48c0-bd95-23b401c6c98c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:38.475642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb771f2-ed2a-48c0-bd95-23b401c6c98c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:38.475642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 118/236] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:38.520857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:38.520857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:38.520857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:38.521101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:38.521101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:38.526275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:38.530380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:38.664604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 119/237] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:38.677908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 119/238] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:38.700636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:38.714360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:38.877353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:38.886274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61665f39-9f7f-429e-b956-54f6acdc3fc0 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:38.950319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:38.962362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cec3f-7055-4bc2-b5b3-f5a796647ca7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:38.968658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:38.969765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:38.969765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:38.970449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:38.994632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:39.005187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:39.006146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:39.006953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:39.012996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 120/239] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:39.019343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.045906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.046717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.046990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.047261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.049215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:39.050664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:39.053962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 120/240] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:39.061469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.168819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e5e29-ac19-48b7-ba3a-513be1cfd1e9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:39.190152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4369-dda9-49d9-96c0-b9981f1d4262 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:39.209935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.211041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.211548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.212084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.213049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:39.214545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:39.215560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:39.217276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d69ac-edd3-46a8-ab0a-f81afd7d4d5c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:39.230393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 121/241] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:39.237824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c079b-35c2-4260-a9ce-9d4a4475651b None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.238177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c079b-35c2-4260-a9ce-9d4a4475651b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.238516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c079b-35c2-4260-a9ce-9d4a4475651b None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.239936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 122/242] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:39.244174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122c397-b660-4539-be73-540ce4be3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.244174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122c397-b660-4539-be73-540ce4be3f22 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.244174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122c397-b660-4539-be73-540ce4be3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.244174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122c397-b660-4539-be73-540ce4be3f22 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.244754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122c397-b660-4539-be73-540ce4be3f22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:39.244963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122c397-b660-4539-be73-540ce4be3f22 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:39.247737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c079b-35c2-4260-a9ce-9d4a4475651b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.308402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:39.344118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 121/243] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:39 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:39.346002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.346346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.346626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.385385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:39.386625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:39.393899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c079b-35c2-4260-a9ce-9d4a4475651b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:39.458694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.461237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.461810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.463030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] PATH_INFO: `/v3/users/75312b49ac27419282c8f22b253ffe52` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.495773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] RBAC: Authorizing `identity:get_user(user_id=75312b49ac27419282c8f22b253ffe52)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:39.497883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:39.504111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 123/244] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/users/75312b49ac27419282c8f22b253ffe52 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:39.511278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.548360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 122/245] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:39.579565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.674454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042c67-3915-48ce-bf8b-62dfca5f2e8d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:39.676837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:39.717157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.718351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27dda-c75d-4d1a-8a90-09a56e7bfd55 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:39.720835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.722439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.722439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.731095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:39.763624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7062-c396-4894-a679-1d6502715afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.765241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7062-c396-4894-a679-1d6502715afa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.765826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7062-c396-4894-a679-1d6502715afa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.767105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7062-c396-4894-a679-1d6502715afa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.785436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f7062-c396-4894-a679-1d6502715afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-552f7062-c396-4894-a679-1d6502715afa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:39.795701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:39.796779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:39.797603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:39.800088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 123/246] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:39.805923 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7062-c396-4894-a679-1d6502715afa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.826193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:39.828020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:39.935447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7062-c396-4894-a679-1d6502715afa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:39.963948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 124/247] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:39.966981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:39.969389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:39.978705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:39.986186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:39.986186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:39.986186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:39.986186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:39.986186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:39.986186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:39.991819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 124/248] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:39.997716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:40.035938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:40.115473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453153c8-3b35-42ba-b3d0-2baf4cad97e4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:40.123571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ea518-a755-4ce9-9477-9627dbac56ad None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:40.156359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:40.157837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.158250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.158451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] PATH_INFO: `/v3/users/95a9817c04714b55bbecd6cc428f723c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.159682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] RBAC: Authorizing `identity:get_user(user_id=95a9817c04714b55bbecd6cc428f723c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:40.161622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:40.163019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 125/249] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/users/95a9817c04714b55bbecd6cc428f723c => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:40.171935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:40.194901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:40.196300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.196859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.197334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.205053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:40.207093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:40.209393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 125/250] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:39 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:40.215537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:40.280411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:40.283728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f21c2-0224-42f3-9d5f-e856d695926d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:40.325081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:40.325866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.331939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.331939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.331939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:40.331939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:40.331939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 126/251] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:40 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:40.337392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:40.338780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:40.390529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5950ac-d373-44a6-8327-1d6ac3d47894 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:40.468641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:40.469921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.470427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.471016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.472113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] RBAC: Adding query filter params (role.id=e504869f5436413e945eb0a95fdfd224, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=75312b49ac27419282c8f22b253ffe52) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:40.472700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:40.474353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb17b2d-1e24-44a1-84f4-decd41a67af3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:40.485807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 126/252] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:40 2022] GET /identity/v3/role_assignments?user.id=75312b49ac27419282c8f22b253ffe52&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=e504869f5436413e945eb0a95fdfd224 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:40.538403 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19705bc0-974d-45de-9b19-94c75b50e2c7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:40.596705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:40.597548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.597828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.603960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1/users/95a9817c04714b55bbecd6cc428f723c/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.604987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=719541d70431436ca6b3d21f00624cc1, user_id=95a9817c04714b55bbecd6cc428f723c, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:40.606568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:40.655123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374f227-11aa-497a-84ce-bee076890401 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.655754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374f227-11aa-497a-84ce-bee076890401 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.656259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374f227-11aa-497a-84ce-bee076890401 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.658836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 127/253] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:40.664052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dae70-c1d1-4dc4-a71e-13d505fc4838 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.664683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dae70-c1d1-4dc4-a71e-13d505fc4838 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.665162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dae70-c1d1-4dc4-a71e-13d505fc4838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.698882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 127/254] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:40 2022] PUT /identity/v3/projects/719541d70431436ca6b3d21f00624cc1/users/95a9817c04714b55bbecd6cc428f723c/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:40.701158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e20dae70-c1d1-4dc4-a71e-13d505fc4838 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:40.706918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e20dae70-c1d1-4dc4-a71e-13d505fc4838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:40.812845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 128/255] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:40.859122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:40.910150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:40.916140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb7f5-0a64-4284-9f74-63d02e428980 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.916431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb7f5-0a64-4284-9f74-63d02e428980 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.916706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb7f5-0a64-4284-9f74-63d02e428980 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.918347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 129/256] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:40.932614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:40.932910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:40.933170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:40.977174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:40.978390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:41.077812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:41.084443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995496e5-5238-4eed-8854-c613b1626fa4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:41.092507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 130/257] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:41.120652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:41.243595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:41.244990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:41.246915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:41.248891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:41.279720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:41.288604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:41.289486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:41.290310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:41.296568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 128/258] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:41.310735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ec80a-cbd3-453c-87b3-ee8dcd4ab5aa None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:41.314755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:41.411368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:41.412490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:41.412956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:41.419942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:41.439844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:41.459455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:41.460402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:41.461207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:41.464062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 131/259] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:41.472487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:41.579987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:41.598154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:41.665216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef6af1-26dd-4cb1-bd19-97aaf9de2bb9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:41.759760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb13ab-02fd-4316-8d55-f259ebbd868b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:41.819947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:41.819947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:41.819947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:41.819947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:41.820353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:41.820353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:41.821068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:41.854658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 129/260] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:41.863845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:41.885209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:41.887942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:41.887942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:41.887942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:41.887942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:41.887942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:41.899947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:41.930384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 132/261] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:41.939362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:42.133364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be021eaa-79c9-4614-942f-6e3904103343 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:42.264644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:42.265908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:42.266241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:42.267101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] PATH_INFO: `/v3/users/e8c544a40b7e46f194e94bb220815878` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:42.270613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c544a40b7e46f194e94bb220815878)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:42.272207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:42.274352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 130/262] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:41 2022] GET /identity/v3/users/e8c544a40b7e46f194e94bb220815878 => generated 283 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:42.279969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:42.332457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:42.338596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ecbc0-0899-4d8e-b606-e7fe5f51ec94 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:42.382077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:42.449047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:42.450172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:42.450446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:42.450774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] PATH_INFO: `/v3/users/e8c544a40b7e46f194e94bb220815878` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:42.452019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c544a40b7e46f194e94bb220815878)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:42.460307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:42.462184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 133/263] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:41 2022] GET /identity/v3/users/e8c544a40b7e46f194e94bb220815878 => generated 283 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:42.468791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:42.584032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b001ee-6385-4163-8654-943c0d4a3ce7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:42.658680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027170f1-ca98-4729-883b-7dfcd39bf7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:42.659426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027170f1-ca98-4729-883b-7dfcd39bf7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:42.659946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027170f1-ca98-4729-883b-7dfcd39bf7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:42.659946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027170f1-ca98-4729-883b-7dfcd39bf7c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:42.713793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abb136-eba3-4e01-b202-33d8c743fb24 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:42.790023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3396c-98a3-4abe-bbf6-05583afaf02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:42.790678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3396c-98a3-4abe-bbf6-05583afaf02e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:42.790958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3396c-98a3-4abe-bbf6-05583afaf02e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:42.791236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3396c-98a3-4abe-bbf6-05583afaf02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:42.837626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027170f1-ca98-4729-883b-7dfcd39bf7c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:42.839055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027170f1-ca98-4729-883b-7dfcd39bf7c3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:42.883945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:42.893844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:42.900287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3396c-98a3-4abe-bbf6-05583afaf02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:42.901792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3396c-98a3-4abe-bbf6-05583afaf02e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.027946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 134/264] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:43.030119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631e13-96e0-453b-85cc-c8fc4e801323 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.030678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631e13-96e0-453b-85cc-c8fc4e801323 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.030974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47631e13-96e0-453b-85cc-c8fc4e801323 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.034110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 135/265] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:43.035304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7397e0-4bda-4963-b9a6-7531bad3e7fc None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.035593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7397e0-4bda-4963-b9a6-7531bad3e7fc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.035874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7397e0-4bda-4963-b9a6-7531bad3e7fc None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.037764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 136/266] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:43.038714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7397e0-4bda-4963-b9a6-7531bad3e7fc None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.054772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 131/267] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:43.056109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1841b2-fbdd-439e-ab3c-6c5e3c2d9d85 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.056401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1841b2-fbdd-439e-ab3c-6c5e3c2d9d85 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.056681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1841b2-fbdd-439e-ab3c-6c5e3c2d9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.076553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5b1841b2-fbdd-439e-ab3c-6c5e3c2d9d85 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:43.077851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5b1841b2-fbdd-439e-ab3c-6c5e3c2d9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:43.159018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:43.168743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 132/268] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:43.170416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.177433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.177433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.181789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7397e0-4bda-4963-b9a6-7531bad3e7fc None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.197795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:43.200048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:43.230040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.231295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.231809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.232480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.233850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:43.236084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.238723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 137/269] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:43.239755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.254262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:43.279787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 133/270] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:43.280776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.350792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb33d6-f120-448e-80c3-6838e7409b90 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.388207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.390804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.391818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.392284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.393669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:43.395268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.400887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69934c9e-1f1e-4a1c-bbe9-014850324614 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.404497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 138/271] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:43.405379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.435133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:43.456085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e5293-badf-441e-832a-bdd624410e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.456907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5293-badf-441e-832a-bdd624410e96 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.457185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5293-badf-441e-832a-bdd624410e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.457638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e5293-badf-441e-832a-bdd624410e96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.468209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e5293-badf-441e-832a-bdd624410e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-873e5293-badf-441e-832a-bdd624410e96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:43.477030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:43.478132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:43.479026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:43.481142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 134/272] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:43.487749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2c15-018e-4149-b493-fa5681fe2281 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.488143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2c15-018e-4149-b493-fa5681fe2281 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.488419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2c15-018e-4149-b493-fa5681fe2281 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.489870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 135/273] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:43.490759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2c15-018e-4149-b493-fa5681fe2281 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.525432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62d28-8dee-40a1-9043-af182bf281ab None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.539010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:43.562212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.563640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.564379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.564814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.565831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=e8c544a40b7e46f194e94bb220815878) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:43.566149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:43.567610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.573548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 139/274] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/role_assignments?user.id=e8c544a40b7e46f194e94bb220815878&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:43.574327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.629453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2c15-018e-4149-b493-fa5681fe2281 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.676651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbaede-ee0a-4181-be5f-463ed7bbd8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.678337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbaede-ee0a-4181-be5f-463ed7bbd8fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.678615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbaede-ee0a-4181-be5f-463ed7bbd8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.679037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbaede-ee0a-4181-be5f-463ed7bbd8fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.680275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbaede-ee0a-4181-be5f-463ed7bbd8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:43.682089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbaede-ee0a-4181-be5f-463ed7bbd8fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.684908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 136/275] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:43.686674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31264d8-578a-4c9f-b7d1-7d3643dbb737 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.687105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31264d8-578a-4c9f-b7d1-7d3643dbb737 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.688529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31264d8-578a-4c9f-b7d1-7d3643dbb737 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.690182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 137/276] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:43.691629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31264d8-578a-4c9f-b7d1-7d3643dbb737 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.751164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:43.776338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc156591-ebd8-4a72-ba52-fb482cf882aa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.827970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.830006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.830444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.830866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.831642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31264d8-578a-4c9f-b7d1-7d3643dbb737 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:43.831845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] RBAC: Adding query filter params (role.id=4348185648f74543ae092c82e26979ee, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=e8c544a40b7e46f194e94bb220815878) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:43.832251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:43.834001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:43.834818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dcd94-de23-4166-bf31-493337e72e1b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.842171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 140/277] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/role_assignments?user.id=e8c544a40b7e46f194e94bb220815878&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=4348185648f74543ae092c82e26979ee => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:43.843817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd82dc2-57db-4995-9d46-b442b461f15a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.844379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd82dc2-57db-4995-9d46-b442b461f15a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.844861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd82dc2-57db-4995-9d46-b442b461f15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.867894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-edd82dc2-57db-4995-9d46-b442b461f15a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:43.869706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-edd82dc2-57db-4995-9d46-b442b461f15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:43.883686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:43.884956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.885389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.885810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:43.886897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:43.887809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:43.889701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:43.907690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 138/278] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:43.909207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:43.963342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 141/279] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:43.973146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:43.973643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:43.974088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.005869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:44.005869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:44.058217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78bee1-b18a-4d20-a0dc-8d88d5692de8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:44.098990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 142/280] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:44.099850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.106016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:44.107747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:44.108499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:44.109083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.110645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:44.112735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:44.114125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:44.208388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace14e-00dd-4113-b488-256d24b44ce6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:44.243459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 139/281] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:30:43 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:44.243459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.256237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:44.275322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:44.276571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:44.276953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:44.277884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] PATH_INFO: `/v3/users/6dd2477abca94448b18c905faabc3f6a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.295638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] RBAC: Authorizing `identity:get_user(user_id=6dd2477abca94448b18c905faabc3f6a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:44.298204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:44.300301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 143/282] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/users/6dd2477abca94448b18c905faabc3f6a => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:44.300301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.370958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c621d-91aa-4e62-8173-b38299ff7adb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:44.409940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:44.428849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:44.429572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:44.429861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:44.430141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.453020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:44.462802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:44.464043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 140/283] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:44.465063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.469032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094833d-800c-43ab-ac67-5c161287530a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:44.529196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:44.529196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:44.529196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:44.529196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.552062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:44.561885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:44.563354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:44.564172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 144/284] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:44.568686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.614003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:44.643947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0425f0-ac47-4960-b78b-2cf60b178742 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:44.698538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:44.702609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:44.704174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:44.705988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.709021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, user.id=6dd2477abca94448b18c905faabc3f6a, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:44.710744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:44.713790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:44.736616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 141/285] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/role_assignments?user.id=6dd2477abca94448b18c905faabc3f6a&scope.system=all&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:44.736616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.829550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ddced-93a1-4494-92dd-3d6171b6fb0d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:44.871838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:44.905363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:44.907891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:44.907891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:44.907891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:44.907891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:44.908230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:44.909668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:44.935827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 145/286] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:44.940687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:44.964845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed3795-f012-47bc-a3f0-cf52ff189392 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:45.007939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:45.008868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:45.009153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:45.009429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:45.010322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:45.010511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:45.011862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:45.023262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 142/287] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:45.033686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:45.065353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285b3b5-793a-4aaf-8c9d-cf80296371aa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:45.074403 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:45.102631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:45.103874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:45.104384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:45.104858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] PATH_INFO: `/v3/users/75312b49ac27419282c8f22b253ffe52` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:45.106280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] RBAC: Authorizing `identity:get_user(user_id=75312b49ac27419282c8f22b253ffe52)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:45.107967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:45.110502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 146/288] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:44 2022] GET /identity/v3/users/75312b49ac27419282c8f22b253ffe52 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:45.116608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:45.205371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:45.260400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900d503-d5b1-46d5-b9ea-0feca9227815 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:45.285041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa2ffb-0e41-4df0-8ebe-54a9044b1310 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:45.317253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:45.318447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:45.318950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:45.319439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:45.321050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:45.322705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:45.325879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 147/289] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:45 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:45.336108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:45.355463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:45.356775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:45.358084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:45.361041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] PATH_INFO: `/v3/users/95a9817c04714b55bbecd6cc428f723c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:45.362713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] RBAC: Authorizing `identity:get_user(user_id=95a9817c04714b55bbecd6cc428f723c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:45.367635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:45.370755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 143/290] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:45 2022] GET /identity/v3/users/95a9817c04714b55bbecd6cc428f723c => generated 297 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:45.378069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:45.531590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:45.558615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc95b3-cfeb-4817-a679-81bed2eed41b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:45.632577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:45.635806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:45.636465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:45.638676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:45.720907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b483e-2e41-4964-9f31-fb03ae860831 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:45.773018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:45.785675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:45.789167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:45.795381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:45.796483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:45.796767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:45.797043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1/users/75312b49ac27419282c8f22b253ffe52/roles/e504869f5436413e945eb0a95fdfd224` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:45.804828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=719541d70431436ca6b3d21f00624cc1, user_id=75312b49ac27419282c8f22b253ffe52, role_id=e504869f5436413e945eb0a95fdfd224)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:45.806265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:45.888020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:45.900860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 148/291] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:30:45 2022] PUT /identity/v3/projects/719541d70431436ca6b3d21f00624cc1/users/75312b49ac27419282c8f22b253ffe52/roles/e504869f5436413e945eb0a95fdfd224 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:45.928331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 144/292] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:30:45.937371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:46.235958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a56bc-3323-49b9-bdd7-1c259e73f3a9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:46.370879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adf876-909b-42d9-8a53-5c9fe40daa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:46.370879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adf876-909b-42d9-8a53-5c9fe40daa57 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:46.370879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adf876-909b-42d9-8a53-5c9fe40daa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:46.370879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adf876-909b-42d9-8a53-5c9fe40daa57 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:46.375943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adf876-909b-42d9-8a53-5c9fe40daa57 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:46.375943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adf876-909b-42d9-8a53-5c9fe40daa57 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:46.375943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 149/293] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:45 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:46.382179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:46.566520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e000a-f9c8-4352-a154-f2d0c64b022f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:46.636908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:46.637935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:46.638448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:46.638931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:46.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=95a9817c04714b55bbecd6cc428f723c) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:46.640487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:46.643769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12a356-f52d-4bdf-a2d9-23e7e81ce459 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:46.656016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fb890-1e02-4e04-8735-2b87dbafa523 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:46.656016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fb890-1e02-4e04-8735-2b87dbafa523 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:46.656016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fb890-1e02-4e04-8735-2b87dbafa523 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:46.656016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 150/294] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:46.662489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08209f75-a887-438b-9e1a-639caaacdfcc None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:46.662720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 145/295] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:46 2022] GET /identity/v3/role_assignments?user.id=95a9817c04714b55bbecd6cc428f723c&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:46.663163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08209f75-a887-438b-9e1a-639caaacdfcc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:46.663442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08209f75-a887-438b-9e1a-639caaacdfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:46.708082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-08209f75-a887-438b-9e1a-639caaacdfcc None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:46.709295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-08209f75-a887-438b-9e1a-639caaacdfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:46.808415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:46.832562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8314-1808-4e19-9694-95e3c05214e6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:46.832562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8314-1808-4e19-9694-95e3c05214e6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:46.832562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a8314-1808-4e19-9694-95e3c05214e6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:46.833330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 151/296] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:46.834158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 146/297] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:46.839597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:46.839886 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:46.840198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:46.864240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a8314-1808-4e19-9694-95e3c05214e6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:46.872862 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:46.877488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:46.929695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:46.964517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 152/298] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:46.995950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a8314-1808-4e19-9694-95e3c05214e6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:46.997264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.033872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.034760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.035110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.037908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.039401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:47.040973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:47.042718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 147/299] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:47.049071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.114980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d58e8f-8000-4c50-a360-1f55f6da8fb6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.132719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:47.156314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bec7fd-78dc-4367-aaf8-bc79a6472e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.157446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec7fd-78dc-4367-aaf8-bc79a6472e1f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.157906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec7fd-78dc-4367-aaf8-bc79a6472e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.158356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bec7fd-78dc-4367-aaf8-bc79a6472e1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.161671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e4f0a-c12a-48ce-a40c-5d880952d3a5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.169650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bec7fd-78dc-4367-aaf8-bc79a6472e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:47.171436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-c6bec7fd-78dc-4367-aaf8-bc79a6472e1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:47.178178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:47.179251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:47.180306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 153/300] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:47.185271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdac05-4455-4377-a8c9-13aa6644d4b7 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.191746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdac05-4455-4377-a8c9-13aa6644d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.191746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdac05-4455-4377-a8c9-13aa6644d4b7 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.191746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 154/301] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:47.191746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdac05-4455-4377-a8c9-13aa6644d4b7 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.208697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596b520-4813-44b0-a027-e9a09be7d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.209819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b520-4813-44b0-a027-e9a09be7d347 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.210373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b520-4813-44b0-a027-e9a09be7d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.210654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596b520-4813-44b0-a027-e9a09be7d347 None admin] PATH_INFO: `/v3/groups` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.211359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596b520-4813-44b0-a027-e9a09be7d347 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:47.212838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596b520-4813-44b0-a027-e9a09be7d347 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:47.290827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 148/302] 10.222.0.45 () {60 vars in 1134 bytes} [Mon Jul 25 12:30:47 2022] POST /identity/v3/groups => generated 229 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:30:47.294725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdac05-4455-4377-a8c9-13aa6644d4b7 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.301680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.302038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.302380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.337274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:47.339432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:47.344674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.344988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.345330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.345611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.346389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:47.346747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:47.348573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:47.363081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 155/303] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:47.369394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.409908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:47.436249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 149/304] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:47.456260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.492399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57f8d0-5566-4345-bb48-a84e088cdb39 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.539446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.540361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.540643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.540917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] PATH_INFO: `/v3/users/595e82ba0e204a01a46a5d5e11a79de9` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.563685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] RBAC: Authorizing `identity:get_user(user_id=595e82ba0e204a01a46a5d5e11a79de9)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:47.565885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:47.568582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 156/305] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:47 2022] GET /identity/v3/users/595e82ba0e204a01a46a5d5e11a79de9 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:47.575241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.590664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:47.595143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32376e-8a6e-42ff-83ed-cbbafbd607ef None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.639386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.640154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.640440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.641444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.653859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:47.663984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:47.664909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:47.665712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 150/306] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:47.670996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:47.684619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:47.699560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9f1c-808c-4f51-89c7-446295b593f4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.748665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.749335 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.749621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.749899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.751395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] RBAC: Adding query filter params (role.id=e504869f5436413e945eb0a95fdfd224, user.id=595e82ba0e204a01a46a5d5e11a79de9, scope.system=all) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:47.751718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:47.753349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:47.759689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 157/307] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Jul 25 12:30:47 2022] GET /identity/v3/role_assignments?user.id=595e82ba0e204a01a46a5d5e11a79de9&scope.system=all&role.id=e504869f5436413e945eb0a95fdfd224 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:47.815028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f040a5-2138-4f2b-ae6b-c8ccc4c00745 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:47.868944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:47.869961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:47.870168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:47.870443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:47.871211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:47.871522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:47.873041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:47.883978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 151/308] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:47.890075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:48.003629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127369-bc99-44df-b244-79cc717cead4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:48.042938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b414-2bb7-4a96-883c-a3117330a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:48.044306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b414-2bb7-4a96-883c-a3117330a4ab None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:48.044787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b414-2bb7-4a96-883c-a3117330a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:48.045229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b414-2bb7-4a96-883c-a3117330a4ab None admin] PATH_INFO: `/v3/users/6dd2477abca94448b18c905faabc3f6a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:48.050433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b414-2bb7-4a96-883c-a3117330a4ab None admin] RBAC: Authorizing `identity:get_user(user_id=6dd2477abca94448b18c905faabc3f6a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:48.050433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b414-2bb7-4a96-883c-a3117330a4ab None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:48.051138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 158/309] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:47 2022] GET /identity/v3/users/6dd2477abca94448b18c905faabc3f6a => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:48.056908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:48.087631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:48.174262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64e946-50f5-4741-a3fa-65e7f29e9f97 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:48.217181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076cce-46ac-416a-8cc2-d4f9cc443c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:48.218092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076cce-46ac-416a-8cc2-d4f9cc443c3a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:48.218378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076cce-46ac-416a-8cc2-d4f9cc443c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:48.218654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076cce-46ac-416a-8cc2-d4f9cc443c3a None admin] PATH_INFO: `/v3/system/users/6dd2477abca94448b18c905faabc3f6a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:48.220389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7076cce-46ac-416a-8cc2-d4f9cc443c3a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6dd2477abca94448b18c905faabc3f6a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:48.221838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7076cce-46ac-416a-8cc2-d4f9cc443c3a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:48.321683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 152/310] 10.222.0.45 () {58 vars in 1334 bytes} [Mon Jul 25 12:30:48 2022] PUT /identity/v3/system/users/6dd2477abca94448b18c905faabc3f6a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:48.547397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf21dc1-0909-4afe-a7d7-cf194e6d7458 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:48.547397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf21dc1-0909-4afe-a7d7-cf194e6d7458 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:48.547397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf21dc1-0909-4afe-a7d7-cf194e6d7458 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:48.547397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 159/311] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:48.553481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:48.553849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:48.554205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:48.573862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:48.575153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:48.645130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 153/312] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:48.670352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf21dc1-0909-4afe-a7d7-cf194e6d7458 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:48.702653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:48.791954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf21dc1-0909-4afe-a7d7-cf194e6d7458 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:48.826517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:48.830228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:48.830228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:48.830228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:48.839003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:48.847004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:48.847912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:48.848759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 160/313] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:48.854364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:48.880404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:48.965618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996c25c-43d4-435c-9404-f940e403f3a1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.007822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.008526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.008807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.009081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.009837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:49.010141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.011533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.020964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 154/314] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:49.026529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:49.120635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:49.136245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1adc43-dd8b-4b8d-bcb2-b451fe0656fe None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.173200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa7b9-5797-498a-822e-741d3d78a347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.174121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa7b9-5797-498a-822e-741d3d78a347 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.174410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa7b9-5797-498a-822e-741d3d78a347 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.174685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa7b9-5797-498a-822e-741d3d78a347 None admin] PATH_INFO: `/v3/users/75312b49ac27419282c8f22b253ffe52` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.175893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa7b9-5797-498a-822e-741d3d78a347 None admin] RBAC: Authorizing `identity:get_user(user_id=75312b49ac27419282c8f22b253ffe52)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.177461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa7b9-5797-498a-822e-741d3d78a347 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.179100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 161/315] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:49 2022] GET /identity/v3/users/75312b49ac27419282c8f22b253ffe52 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:49.184782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:49.280459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:49.292492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a3ab-7eac-4047-b2ed-543412609f9c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.328220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.328901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.329183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.329455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.399663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.401097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.448431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc033a14-3168-473f-b50e-bfe5788a2ac3 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.448836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc033a14-3168-473f-b50e-bfe5788a2ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.449121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc033a14-3168-473f-b50e-bfe5788a2ac3 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.452212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 162/316] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:49.459865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.463958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.463958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.480214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:49.481402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:49.486574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:49.517948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 155/317] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:49.523425 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:49.567896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 163/318] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:49.590835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:49.654184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8f7c3-5d35-4535-8228-d7adc43bf0bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.675270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:49.699248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.700410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.700870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.701325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.702758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.703956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3291c-f13e-4ded-8fdd-92605520efa3 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.704821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.711655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 156/319] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:49 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:49.712795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:49.741763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.742680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.743021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.743368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.744871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.746423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.748134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 164/320] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:49.755055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:49.766851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:49.829738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dccebb-5889-46a3-9ea3-4c04ab7e1519 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.863506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be742-d27b-4e1a-ac20-c823ff3b99f3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:49.865290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.865948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.866230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.866503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.867328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] RBAC: Adding query filter params (role.id=e504869f5436413e945eb0a95fdfd224, scope.project.id=719541d70431436ca6b3d21f00624cc1, user.id=75312b49ac27419282c8f22b253ffe52) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:49.867638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.869385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea90be-9022-4f1c-8303-bafc01b757ae None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.876095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 157/321] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:30:49 2022] GET /identity/v3/role_assignments?user.id=75312b49ac27419282c8f22b253ffe52&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=e504869f5436413e945eb0a95fdfd224 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:49.876876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795a40a-2db7-4843-8117-226a2372aac8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.877163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795a40a-2db7-4843-8117-226a2372aac8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.877438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795a40a-2db7-4843-8117-226a2372aac8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.878942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 158/322] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:49.893649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.894584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.894985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.906382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:49.906941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:49.907279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:49.907560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] PATH_INFO: `/v3/groups` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:49.908342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:49.909874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:49.916443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:49.918102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:49.999020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 159/323] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:50.022819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:50.033240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 165/324] 10.222.0.45 () {60 vars in 1134 bytes} [Mon Jul 25 12:30:49 2022] POST /identity/v3/groups => generated 226 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:30:50.091765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:50.174101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc5051-f463-4d6c-9efa-80ef0913f0d1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:50.212814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:50.213621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.213904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.214183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.225378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:50.233328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:50.234206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:50.235047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:50.235667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 160/325] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:50.243784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:50.257921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:50.360024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f8454-4317-4c3a-826f-ea2bbdf073b6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:50.397253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:50.397936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.398218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.398491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.399247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:50.399554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:50.401011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c91f26-db15-49e1-811c-021190e946f7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:50.410753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 166/326] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:50.416424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:50.469093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4f953-f80b-484f-aa9f-ccd36357c702 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.469093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4f953-f80b-484f-aa9f-ccd36357c702 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.469093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4f953-f80b-484f-aa9f-ccd36357c702 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.469965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 167/327] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:30:50.475141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f99c2-1770-449c-b576-234338d92379 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.475424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f99c2-1770-449c-b576-234338d92379 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.475700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f99c2-1770-449c-b576-234338d92379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.504283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-285f99c2-1770-449c-b576-234338d92379 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:50.505498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-285f99c2-1770-449c-b576-234338d92379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:50.539350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:50.543068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d32e9-e659-4c3d-8074-fefca10f6d0b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:50.584255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:50.585304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.585633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.585914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] PATH_INFO: `/v3/users/595e82ba0e204a01a46a5d5e11a79de9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.587205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 168/328] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:50.587378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] RBAC: Authorizing `identity:get_user(user_id=595e82ba0e204a01a46a5d5e11a79de9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:50.595987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:50.595987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 161/329] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:50 2022] GET /identity/v3/users/595e82ba0e204a01a46a5d5e11a79de9 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:50.597615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f99c2-1770-449c-b576-234338d92379 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:50.600251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:50.614020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:50.709353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f99c2-1770-449c-b576-234338d92379 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:50.749128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:50.750093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.750372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.750645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] PATH_INFO: `/v3/system/users/595e82ba0e204a01a46a5d5e11a79de9/roles/e504869f5436413e945eb0a95fdfd224` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.751233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace9ead-fd9a-48e4-956b-3a5e674cc843 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:50.752166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=595e82ba0e204a01a46a5d5e11a79de9, role_id=e504869f5436413e945eb0a95fdfd224)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:50.753541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:50.794710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:50.795871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.796394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.797420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.813556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:50.822729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:50.823646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:50.824745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 162/330] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:30:50.829989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:50.841579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 169/331] 10.222.0.45 () {58 vars in 1334 bytes} [Mon Jul 25 12:30:50 2022] PUT /identity/v3/system/users/595e82ba0e204a01a46a5d5e11a79de9/roles/e504869f5436413e945eb0a95fdfd224 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:30:50.872218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:50.951577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7b9c-cb59-41a5-991c-9c085fa8a961 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:50.991850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:50.992695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:50.992987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:50.993266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:50.994276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:50.994592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:50.996212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:51.006312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 163/332] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:51.011979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:51.095082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:51.132901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757bd69-d4ae-4925-a259-0984d354f1d5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:51.175375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c072877-46bf-4c77-8813-e97045b31f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:51.176523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072877-46bf-4c77-8813-e97045b31f39 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:51.176812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072877-46bf-4c77-8813-e97045b31f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:51.177095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c072877-46bf-4c77-8813-e97045b31f39 None admin] PATH_INFO: `/v3/users/6dd2477abca94448b18c905faabc3f6a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:51.178534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072877-46bf-4c77-8813-e97045b31f39 None admin] RBAC: Authorizing `identity:get_user(user_id=6dd2477abca94448b18c905faabc3f6a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:51.180206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c072877-46bf-4c77-8813-e97045b31f39 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:51.182217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 170/333] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:51 2022] GET /identity/v3/users/6dd2477abca94448b18c905faabc3f6a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:51.188994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:51.332390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:51.350675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4025241-b4ba-40a9-9ca5-ad49df111a4a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:51.422579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:51.423327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:51.423608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:51.423881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:51.424814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] RBAC: Adding query filter params (role.id=cacd3e0b20764818bd998ab848b2a854, user.id=6dd2477abca94448b18c905faabc3f6a, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:51.425127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:51.426710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a71079-dd32-47de-a763-69ea41fa1b38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:51.447731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 164/334] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Jul 25 12:30:51 2022] GET /identity/v3/role_assignments?user.id=6dd2477abca94448b18c905faabc3f6a&scope.system=all&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:52.725822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa074b12-7b23-4fdc-ba60-f7d0b3d14fd1 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:52.726338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa074b12-7b23-4fdc-ba60-f7d0b3d14fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:52.726421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa074b12-7b23-4fdc-ba60-f7d0b3d14fd1 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:52.728126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 171/335] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:52.733583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f784a-e7da-405d-b0d5-b6e5e7261f68 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:52.735110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f784a-e7da-405d-b0d5-b6e5e7261f68 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:52.735627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f784a-e7da-405d-b0d5-b6e5e7261f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:52.771218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-846f784a-e7da-405d-b0d5-b6e5e7261f68 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:52.772835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-846f784a-e7da-405d-b0d5-b6e5e7261f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:52.865834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 165/336] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:52.910761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa074b12-7b23-4fdc-ba60-f7d0b3d14fd1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:52.977737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699205e-e8de-4527-8ef6-6fb284a8e578 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:52.978325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699205e-e8de-4527-8ef6-6fb284a8e578 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:52.978885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699205e-e8de-4527-8ef6-6fb284a8e578 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:52.982732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 166/337] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:52.988704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:52.989243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:52.990078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.028967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:53.030184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:53.089740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa074b12-7b23-4fdc-ba60-f7d0b3d14fd1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:53.152117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 167/338] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:53.160974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:53.161793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.162077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.162353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.174592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:53.184513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:53.193570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:53.194481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:53.195336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 172/339] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:53.201828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:53.217080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:53.218384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:53.390129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b9a07-78fe-44d4-addb-df2906563c7a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:53.430842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8cc6-146c-49eb-b45d-9e86bd307001 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:53.467113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:53.467315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.467541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.467718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.470617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:53.470617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:53.471381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:53.491942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:53.491942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.491942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.491942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.496464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 168/340] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:53.505000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:53.513598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:53.530343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:53.531422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:53.532682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 173/341] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:53.539522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:53.624395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:53.630138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:53.670977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62433649-884f-459e-bb54-2f0b9afc5a5a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:53.691187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf140b-d166-4afb-8f9e-9cfec390120e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:53.726113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:53.727750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.728376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.728864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.729890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:53.730240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95306475-6dcf-4976-a7d3-e8b6631850ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:53.730582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:53.731006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95306475-6dcf-4976-a7d3-e8b6631850ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.731369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95306475-6dcf-4976-a7d3-e8b6631850ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.731710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95306475-6dcf-4976-a7d3-e8b6631850ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.735446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ed6dc-8dd8-479a-b8bc-7c0395937046 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:53.752597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 174/342] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:53.754418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29c249-718d-4644-9478-091ef5a9e474 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.754880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29c249-718d-4644-9478-091ef5a9e474 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.755328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29c249-718d-4644-9478-091ef5a9e474 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.760719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 175/343] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:53.762251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.762777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.763225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.797320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:53.798886 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:53.810479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95306475-6dcf-4976-a7d3-e8b6631850ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:53.815951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95306475-6dcf-4976-a7d3-e8b6631850ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:53.893822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:53.901709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 176/344] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:53.902556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:53.931367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 169/345] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:53.931945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df794b-8666-4c95-9cd3-2ca4b313d294 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:53.932305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df794b-8666-4c95-9cd3-2ca4b313d294 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:53.934034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df794b-8666-4c95-9cd3-2ca4b313d294 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:53.934034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 170/346] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:53.934590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df794b-8666-4c95-9cd3-2ca4b313d294 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:53.957345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.018320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a393e-94fa-4508-8b59-cd6da3eefa30 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.067677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df794b-8666-4c95-9cd3-2ca4b313d294 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.067893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4eaaa-c3e8-4e2b-928e-059e4185677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.067893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4eaaa-c3e8-4e2b-928e-059e4185677a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.067893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4eaaa-c3e8-4e2b-928e-059e4185677a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.068176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4eaaa-c3e8-4e2b-928e-059e4185677a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.105862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.106851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.107135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.107406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.121154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:54.129741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:54.130688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 171/347] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:54.132216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.154303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4eaaa-c3e8-4e2b-928e-059e4185677a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.155780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4eaaa-c3e8-4e2b-928e-059e4185677a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.172173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.219974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.261964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6a7d0-2073-4a92-b23d-e6d245376e6d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.297513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 177/348] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:54.301166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.301166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.301166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.310528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.312139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.312644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.312811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.314395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.315864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.317723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 172/349] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:54.317961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:54.318485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.319159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:54.414420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 178/350] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:54.415066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.459946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.479781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f56ca-8ea0-4abe-95d4-c91f43ebca49 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.517833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.527152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.529684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.529684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.529684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.529684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:54.529684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.531801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.544595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536569a-870b-4675-9507-a3dce8e64e9a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.544846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 173/351] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:54.545893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.589340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.590545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.591010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.591465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.592885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.595588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.597598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 179/352] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:54.600222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.673494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d3c58-5e5f-4314-9169-cc9b04d1825c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.719830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.721136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.721136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.721136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.727071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac34d1-4b45-4675-a6e9-3e7beaa5720d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.727527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.729033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.731026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 174/353] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:54.731825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.760885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.771208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.778511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.778511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.778511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.785066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:54.793127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:54.794032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:54.794834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 180/354] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:54.795483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.799350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:54.866773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb9af-05e0-422f-a00f-126b443ef645 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.920721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b30ab-4c1e-4502-b623-601df5a06bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.922606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b30ab-4c1e-4502-b623-601df5a06bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.923109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b30ab-4c1e-4502-b623-601df5a06bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.923591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b30ab-4c1e-4502-b623-601df5a06bb8 None admin] PATH_INFO: `/v3/users/595e82ba0e204a01a46a5d5e11a79de9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.924193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0485a-0085-4e6a-889d-f331f3c940f6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:54.925420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b30ab-4c1e-4502-b623-601df5a06bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=595e82ba0e204a01a46a5d5e11a79de9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.928095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b30ab-4c1e-4502-b623-601df5a06bb8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.934350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 175/355] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/users/595e82ba0e204a01a46a5d5e11a79de9 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:54.934350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed07d1-40f1-495f-b47e-e3788c52e240 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.934350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed07d1-40f1-495f-b47e-e3788c52e240 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.934350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed07d1-40f1-495f-b47e-e3788c52e240 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.936185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 176/356] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:54.938157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed07d1-40f1-495f-b47e-e3788c52e240 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:54.982801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:54.983156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:54.983435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:54.983737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:54.986008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:54.987285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:54.989853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 181/357] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:54.989853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:55.060051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:55.075034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed07d1-40f1-495f-b47e-e3788c52e240 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:55.079164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:55.117845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1433e5-a806-4790-8430-f7a6275330b2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:55.123994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:55.124182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.125091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.125091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.126098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=4348185648f74543ae092c82e26979ee, scope.project.id=33b4d6311007470cb1808231ad28bd3a) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:55.126415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:55.127893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:55.133859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 177/358] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=4348185648f74543ae092c82e26979ee => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:55.134660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:55.167660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:55.168490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.168869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.169215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.170069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:55.170806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:55.171908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9e280-7c3a-4421-b0fc-5f6bec87379a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:55.183621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 182/359] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:55.185339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee371-02b3-4afb-b7d3-9a39245ba181 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.185817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee371-02b3-4afb-b7d3-9a39245ba181 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.186098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee371-02b3-4afb-b7d3-9a39245ba181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.216492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ef5ee371-02b3-4afb-b7d3-9a39245ba181 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:55.217725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ef5ee371-02b3-4afb-b7d3-9a39245ba181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:55.271152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db04b6-d9f3-4cc9-af5a-dff50a7fb2ee None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:55.326266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:55.326266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.326553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.326801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.327909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] RBAC: Adding query filter params (role.id=e504869f5436413e945eb0a95fdfd224, user.id=595e82ba0e204a01a46a5d5e11a79de9, scope.system=all) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:55.327909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:55.329689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 183/360] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:55.330586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:55.331136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e56ae-7c15-4741-8658-b3fde1ea75cc None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.331136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e56ae-7c15-4741-8658-b3fde1ea75cc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.331387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e56ae-7c15-4741-8658-b3fde1ea75cc None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.332915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 184/361] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:55.338909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e56ae-7c15-4741-8658-b3fde1ea75cc None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:55.345512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 178/362] 10.222.0.45 () {56 vars in 1308 bytes} [Mon Jul 25 12:30:55 2022] GET /identity/v3/role_assignments?user.id=595e82ba0e204a01a46a5d5e11a79de9&scope.system=all&role.id=e504869f5436413e945eb0a95fdfd224 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:55.346367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:55.366940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:55.441717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:55.490846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e56ae-7c15-4741-8658-b3fde1ea75cc None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:55.492295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bd7db-7207-4e82-a77b-8fec0e283e68 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:55.548105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:55.548703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.548983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.549254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.551546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:55.552235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.552751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.553025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.554815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=33b4d6311007470cb1808231ad28bd3a) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:55.555131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:55.556621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a450bca-2d8b-45c1-8d73-6e78e82748c5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:55.564489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 185/363] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:30:55 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:55.565845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.566084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.566355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.589452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:55.591176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:55.672311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:55.674401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:55.696328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:55.707130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 186/364] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:55.710571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:55.797007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:55.843128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 179/365] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:55.850131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:55.852995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283f4fb-e3e9-47a3-a5cd-1acda86a3f70 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:55.913282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:55.914111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:55.914386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:55.914653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:55.928840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:55.939846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:55.940785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:55.941591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:55.947954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 187/366] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:55.947954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.006961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3429d3-4870-455f-830a-1ae09d497a3a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.025035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.049205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.050063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.050446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.052875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.064642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:56.074597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:56.075509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:30:56.076374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:56.080275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 180/367] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:56.081539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.117236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83581f-2029-40a4-8763-00cabac08eed None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.145356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.166193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.167451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.167965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.168457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.169861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.172102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.174433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 188/368] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:55 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:56.175573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.213964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a689e-dca7-4711-81ad-1ae14f2a333a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.260550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.261688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.262163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.262627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.263637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:56.264210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.265986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.275618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 181/369] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:56.276937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.298188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e2b37-bc7d-4c45-bcaf-1b7c6e76d90c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.322043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.336063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.336738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.337018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.337291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.338036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:56.338342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.339708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.349581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 189/370] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:56.350010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.403551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fcb78-8f06-4778-9f3c-df2321b56569 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.406450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.446832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.448423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.448961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.449530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.451204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.453866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.456307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 182/371] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:56.457500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.474750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace79347-a05d-4ef4-afbb-97131bf89b98 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.512137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.512775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.513037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.513315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.573677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb40cc-06ce-4579-800c-01bbe2b12f18 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.575574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.593863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.596073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.625269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.626398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.626893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.627462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.655815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.723380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.725183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.736745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 190/372] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:56.740083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.856580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 183/373] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:30:56.857571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.867151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:56.895822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf375a14-e0a1-44dc-aaa2-fbb4c080c021 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.936238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:56.937379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:56.937868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:56.938364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:56.939392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=719541d70431436ca6b3d21f00624cc1) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:56.939904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:56.941721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:56.955955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 191/374] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:56.957452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:56.976137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35ea92-f810-400f-b5e6-f75d9e5689c8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:56.979139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:57.015947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:57.015947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.015947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.015947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.016763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:57.018119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:57.020238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 184/375] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:57.026258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:57.110299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:57.124215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d085-b097-4ab7-bf33-f0641f50575b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:57.146888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69aa22-6d7c-4a26-adce-ec5d8d4855e2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:57.183784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:57.185014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.185587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.186042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] PATH_INFO: `/v3/projects/008d6127b7814e42964dd897d624be5f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.189212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] RBAC: Authorizing `identity:get_project(project_id=008d6127b7814e42964dd897d624be5f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:57.190234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:57.191112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:57.191216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.191517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.191856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.193155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:57.193992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 192/376] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:56 2022] GET /identity/v3/projects/008d6127b7814e42964dd897d624be5f => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:57.198341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:57.198341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 185/377] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:57 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:57.199426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:57.202018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:57.321135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:57.325645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be02061-b737-4f49-852e-fb5d67a2e359 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:57.343766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e2ce6-be1d-445d-a861-6f32363bdb37 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:57.366590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:57.367475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.367608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.367810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.368693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=4348185648f74543ae092c82e26979ee, scope.project.id=719541d70431436ca6b3d21f00624cc1) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:57.369258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:57.370702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:57.377381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 186/378] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:30:57 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=4348185648f74543ae092c82e26979ee => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:57.389428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11f699-fd36-4297-96a3-757493c541c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:57.391476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f699-fd36-4297-96a3-757493c541c7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.392041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f699-fd36-4297-96a3-757493c541c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.392524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f699-fd36-4297-96a3-757493c541c7 None admin] PATH_INFO: `/v3/groups/4bf611b481b344788cb6f14176471d22` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.400374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f699-fd36-4297-96a3-757493c541c7 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf611b481b344788cb6f14176471d22)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:57.402221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f699-fd36-4297-96a3-757493c541c7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:57.404665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 193/379] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:57 2022] GET /identity/v3/groups/4bf611b481b344788cb6f14176471d22 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:57.411591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:57.416275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:57.584616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63018d9-2a20-4da4-860f-02e89eb70612 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.585278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63018d9-2a20-4da4-860f-02e89eb70612 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.585828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63018d9-2a20-4da4-860f-02e89eb70612 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.587655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 194/380] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:57.593164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74068b11-fe99-4042-8065-f7ffbb984c67 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.593744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74068b11-fe99-4042-8065-f7ffbb984c67 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.594238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74068b11-fe99-4042-8065-f7ffbb984c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.611628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e724a9-fd19-4816-b61a-d224e9b5c7fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:57.627052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-74068b11-fe99-4042-8065-f7ffbb984c67 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:57.628790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-74068b11-fe99-4042-8065-f7ffbb984c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:57.694951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:57.694951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.694951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.694951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.695374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] RBAC: Adding query filter params (group.id=4bf611b481b344788cb6f14176471d22, role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=008d6127b7814e42964dd897d624be5f) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:57.695374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:57.695374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:57.714982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 187/381] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:30:57 2022] GET /identity/v3/role_assignments?group.id=4bf611b481b344788cb6f14176471d22&scope.project.id=008d6127b7814e42964dd897d624be5f&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:57.772044 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 195/382] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:30:57.811160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:57.959234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:57.994936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985720c5-9d2b-4520-9d83-9960a5b89006 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:57.995909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985720c5-9d2b-4520-9d83-9960a5b89006 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:57.996470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985720c5-9d2b-4520-9d83-9960a5b89006 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:57.998053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 196/383] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:58.005684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.006020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.006302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.007546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf14002-b448-4cde-8f5e-deeaf8beedbf None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:58.050663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:58.052313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.052805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.053283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.067288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:58.068580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:30:58.085516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:58.100205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:58.101197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:30:58.102044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:30:58.108653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 188/384] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:30:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:58.117127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:58.173585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 197/385] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:30:58.205702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:58.209116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:58.350746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c7224-889d-48f8-826f-a012b531ee24 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:58.391412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e81613-45e3-42c1-a776-5f97b0a0fe97 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:58.406906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:58.418555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:58.419233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.419516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.419793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.420573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:58.420882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:58.422302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:58.442458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 189/386] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:30:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:58.450268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:58.454008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:58.454828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.455110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.455382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.466466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:30:58.476241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:30:58.477157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:30:58.478427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 198/387] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:30:58.489154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:58.585374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d73d4f-7610-4db0-890b-43bc45f265e4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:58.655480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:58.669307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:58.676944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.676944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.676944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.676944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:58.678217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:58.682504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 190/388] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:58 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:58.690382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:58.746818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d67a19-2814-4ca1-993b-7f1231a5778c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:58.796915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:58.820965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:58.823941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.823941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.823941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.823941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:30:58.823941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:58.824595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:58.850161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 199/389] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:30:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:58.856269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:58.885487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc287319-fc9b-4318-a421-fe21c2be5652 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:58.943272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:58.944093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:58.944378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:58.944653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:58.947201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:58.948733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:58.950731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 191/390] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:58 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:58.956875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:59.025569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea212520-9cd7-43c2-ad48-ac8030dc597f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:59.056197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:59.067588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:59.074458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:59.074458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:59.074458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:59.074458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:59.074458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:59.074458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 200/391] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:30:58 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:30:59.081025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:59.142364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb72b-b56a-4b29-8fcd-9942d0141913 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:59.207475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:59.226098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e23a3-a6e3-4d70-ba3c-1256541f7ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:59.227161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e23a3-a6e3-4d70-ba3c-1256541f7ecf None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:59.227446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e23a3-a6e3-4d70-ba3c-1256541f7ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:59.227719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e23a3-a6e3-4d70-ba3c-1256541f7ecf None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a/groups/49384188cc91443d9985a7efba5b4a8a/roles/4348185648f74543ae092c82e26979ee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:59.233189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e23a3-a6e3-4d70-ba3c-1256541f7ecf None admin] RBAC: Authorizing `identity:create_grant(project_id=33b4d6311007470cb1808231ad28bd3a, group_id=49384188cc91443d9985a7efba5b4a8a, role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:59.234718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e23a3-a6e3-4d70-ba3c-1256541f7ecf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:59.263122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6305c3-b3b2-4732-b4da-05a4720ca0f3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:59.312735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:59.313800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:59.315948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:59.315948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:59.315948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:59.317143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:59.323327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 201/392] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:30:59 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:30:59.324959 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:30:59.340088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 192/393] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Jul 25 12:30:58 2022] PUT /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a/groups/49384188cc91443d9985a7efba5b4a8a/roles/4348185648f74543ae092c82e26979ee => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:30:59.407339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:30:59.451945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b2435-05e4-4197-846f-0064369d40fd None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:30:59.507254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222fc4d-25e9-4a72-a0c0-fa06e76a9afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:30:59.508199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fc4d-25e9-4a72-a0c0-fa06e76a9afd None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:59.508674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fc4d-25e9-4a72-a0c0-fa06e76a9afd None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:59.509179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222fc4d-25e9-4a72-a0c0-fa06e76a9afd None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a/groups/49384188cc91443d9985a7efba5b4a8a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:59.511418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fc4d-25e9-4a72-a0c0-fa06e76a9afd None admin] RBAC: Authorizing `identity:create_grant(project_id=33b4d6311007470cb1808231ad28bd3a, group_id=49384188cc91443d9985a7efba5b4a8a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:30:59.513101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222fc4d-25e9-4a72-a0c0-fa06e76a9afd None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:30:59.614652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 202/394] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Jul 25 12:30:59 2022] PUT /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a/groups/49384188cc91443d9985a7efba5b4a8a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:30:59.851614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa03f-40be-43a4-bd93-2ed841b66256 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:59.851614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa03f-40be-43a4-bd93-2ed841b66256 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:59.851614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa03f-40be-43a4-bd93-2ed841b66256 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:59.856404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 193/395] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:30:59.857855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:30:59.859302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:30:59.859302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:30:59.896851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:30:59.900003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:00.012078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1116c7-2711-4780-a126-f5c5b39d2d00 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.013770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1116c7-2711-4780-a126-f5c5b39d2d00 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.014214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1116c7-2711-4780-a126-f5c5b39d2d00 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.015812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 194/396] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:00.021401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19440e-95bb-4cee-a14f-b7d4e36dde15 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.022107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19440e-95bb-4cee-a14f-b7d4e36dde15 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.022615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19440e-95bb-4cee-a14f-b7d4e36dde15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.044252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 203/397] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:00.060492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bb19440e-95bb-4cee-a14f-b7d4e36dde15 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:00.062089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bb19440e-95bb-4cee-a14f-b7d4e36dde15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:00.087655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:00.207622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:00.251065 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 195/398] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:00.257375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362407-07f0-4a56-ad74-469663466909 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.258825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362407-07f0-4a56-ad74-469663466909 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.258825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362407-07f0-4a56-ad74-469663466909 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.259413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 196/399] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:00.264685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.265059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.265663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.293293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30f2d-9ae3-4511-8744-8a000d0f5906 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:00.305078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:00.306357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:00.337543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:00.338599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.339043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.339464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.354192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:00.365566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:00.366497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:31:00.367379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:00.370726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 204/400] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:00.371824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:00.461087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 197/401] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:00.462554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:00.520464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31e5a2-b4c9-42a0-b487-ae2a490be4e5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:00.548486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:00.553148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:00.602528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:00.602528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.602528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.602528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.618510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:00.630048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:00.631007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:00.631813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:00.635010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 205/402] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:00.636107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:00.643711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb40cd-1896-435a-8709-83be1bf37426 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:00.701172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:00.702009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.702939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.703326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.706058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:00.707889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:00.709556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:00.726196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 198/403] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:00.726957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:00.836738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27e7c7-fb62-4093-bcd9-43aa1b7dd59b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:00.913967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faa731-eb28-4353-9bbb-27480be8dfc2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:00.919089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:00.919089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.919089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.919089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.924446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:00.937281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:00.954267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:00.955197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:00.956023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:00.957612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 206/404] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:00.959149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:00.965431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:00.966395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:00.966881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:00.967378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:00.968435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:00.972473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:00.974112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:00.997740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 199/405] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:00.998941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.032483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:01.135035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405bd15-be61-4f23-b947-30c45df3791e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.188263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.189762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.190333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.191597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.193765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.195885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e3bd5-2058-4e9e-950c-30f9d749845d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.197578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.207130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 207/406] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.208336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.267852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.268511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.268768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.269043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.269797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:01.270110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.271492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.290157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 200/407] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.291864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.347959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:01.407358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:01.416517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdfb32-54b7-4657-bd9e-54f0933e2284 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.452990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed249d5-9f9b-4d21-9ecf-39315f3debbe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.493510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.496136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.496751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.497380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.500372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.502744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.504840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 208/408] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:01 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.507230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.526510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.527308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.527589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.527864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.531052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.533601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.537030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 201/409] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:01 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.539626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.687603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc23b2-1436-4d24-996c-0a2b430b837a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.731635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.733025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.733955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.734431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] PATH_INFO: `/v3/groups/4bf611b481b344788cb6f14176471d22` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.735910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf611b481b344788cb6f14176471d22)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.737783 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.740359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 209/410] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:01 2022] GET /identity/v3/groups/4bf611b481b344788cb6f14176471d22 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.741311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.746501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:01.753677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197dc8-67aa-4fbd-88c2-8b4dd534dc38 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.788811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:01.820777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.821659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.822007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.822209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.823523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.825235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.831499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 202/411] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:01 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.831499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:01.875420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb0e3-e0b5-43f6-be6d-4686b9688c20 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.919626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947779d-c6e2-47c1-b987-c9ecfe6b39dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.921027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947779d-c6e2-47c1-b987-c9ecfe6b39dc None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.921367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947779d-c6e2-47c1-b987-c9ecfe6b39dc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.921664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947779d-c6e2-47c1-b987-c9ecfe6b39dc None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1/groups/49384188cc91443d9985a7efba5b4a8a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.924155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947779d-c6e2-47c1-b987-c9ecfe6b39dc None admin] RBAC: Authorizing `identity:create_grant(project_id=719541d70431436ca6b3d21f00624cc1, group_id=49384188cc91443d9985a7efba5b4a8a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.925625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947779d-c6e2-47c1-b987-c9ecfe6b39dc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.949969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1405ea-ff86-4ab3-ab66-9a12e22251fc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:01.986804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be5e75-26d9-482f-9aa1-e397e072c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:01.987664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5e75-26d9-482f-9aa1-e397e072c39f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.988668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5e75-26d9-482f-9aa1-e397e072c39f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.988668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be5e75-26d9-482f-9aa1-e397e072c39f None admin] PATH_INFO: `/v3/projects/008d6127b7814e42964dd897d624be5f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.989509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be5e75-26d9-482f-9aa1-e397e072c39f None admin] RBAC: Authorizing `identity:get_project(project_id=008d6127b7814e42964dd897d624be5f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:01.990954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be5e75-26d9-482f-9aa1-e397e072c39f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:01.992713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 203/412] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:01 2022] GET /identity/v3/projects/008d6127b7814e42964dd897d624be5f => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:01.994186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec274d2-6772-4e9e-958a-cbbaccdc681f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:01.994467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec274d2-6772-4e9e-958a-cbbaccdc681f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:01.994739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec274d2-6772-4e9e-958a-cbbaccdc681f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:01.996192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 204/413] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:02.000724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec274d2-6772-4e9e-958a-cbbaccdc681f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:02.024766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 210/414] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Jul 25 12:31:01 2022] PUT /identity/v3/projects/719541d70431436ca6b3d21f00624cc1/groups/49384188cc91443d9985a7efba5b4a8a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:02.026447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b45f-fe4b-4287-b7ce-927e94d33642 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.026892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b45f-fe4b-4287-b7ce-927e94d33642 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.027176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703b45f-fe4b-4287-b7ce-927e94d33642 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.028565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 211/415] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:02.029296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b45f-fe4b-4287-b7ce-927e94d33642 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:02.041701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:02.130082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec274d2-6772-4e9e-958a-cbbaccdc681f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:02.167880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:02.176457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703b45f-fe4b-4287-b7ce-927e94d33642 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:02.182777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6e4ef-e798-475b-b74e-31a2384c3a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:02.182777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6e4ef-e798-475b-b74e-31a2384c3a8d None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.182777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6e4ef-e798-475b-b74e-31a2384c3a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.182777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6e4ef-e798-475b-b74e-31a2384c3a8d None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1/groups/49384188cc91443d9985a7efba5b4a8a/roles/4348185648f74543ae092c82e26979ee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.183779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6e4ef-e798-475b-b74e-31a2384c3a8d None admin] RBAC: Authorizing `identity:create_grant(project_id=719541d70431436ca6b3d21f00624cc1, group_id=49384188cc91443d9985a7efba5b4a8a, role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:02.183779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6e4ef-e798-475b-b74e-31a2384c3a8d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:02.216249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fda3-9330-4748-ae42-bc11f84c481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:02.217134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fda3-9330-4748-ae42-bc11f84c481f None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.218737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fda3-9330-4748-ae42-bc11f84c481f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.218737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fda3-9330-4748-ae42-bc11f84c481f None admin] PATH_INFO: `/v3/projects/008d6127b7814e42964dd897d624be5f/groups/4bf611b481b344788cb6f14176471d22/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.220458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474fda3-9330-4748-ae42-bc11f84c481f None admin] RBAC: Authorizing `identity:create_grant(project_id=008d6127b7814e42964dd897d624be5f, group_id=4bf611b481b344788cb6f14176471d22, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:02.221942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474fda3-9330-4748-ae42-bc11f84c481f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:02.286814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 205/416] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Jul 25 12:31:01 2022] PUT /identity/v3/projects/719541d70431436ca6b3d21f00624cc1/groups/49384188cc91443d9985a7efba5b4a8a/roles/4348185648f74543ae092c82e26979ee => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:02.288201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.288482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.288753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.313034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:02.319491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:02.323085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 212/417] 10.222.0.45 () {58 vars in 1442 bytes} [Mon Jul 25 12:31:02 2022] PUT /identity/v3/projects/008d6127b7814e42964dd897d624be5f/groups/4bf611b481b344788cb6f14176471d22/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:02.324676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b670-aa21-441f-9628-01868893dc91 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.324965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b670-aa21-441f-9628-01868893dc91 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.331141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930b670-aa21-441f-9628-01868893dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.360294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e930b670-aa21-441f-9628-01868893dc91 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:02.363697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e930b670-aa21-441f-9628-01868893dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:02.442096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 206/418] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:02.484714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:02.493672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 213/419] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:02.521513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:02.531245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930b670-aa21-441f-9628-01868893dc91 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:02.660011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2b497-2faa-4271-add4-bc3351301786 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:02.680704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:02.705953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930b670-aa21-441f-9628-01868893dc91 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:02.730122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:02.735239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.735239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.735239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.764392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:02.778434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:02.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:02.780348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 207/420] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:02.785466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:02.786596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:02.788129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:02.788129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:02.793924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:02.810693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:02.825633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:02.826581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:31:02.828313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:02.831455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 214/421] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:02.833856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:02.964021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:02.974950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422852ca-820b-443d-9eca-be50ffedc789 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:03.033039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:03.033039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:03.033328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:03.033707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:03.036028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:03.037560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:03.043182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:03.060718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 208/422] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:03.065147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:03.102838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9abe-2d5c-4650-a513-05b9dfcf7096 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:03.173014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:03.173791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:03.175675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:03.175985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:03.177961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:03.178287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:03.182378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:03.204896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 215/423] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:31:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:03.209481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:03.230771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:03.277052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff7167-bb4f-459e-9f71-f133a25bf171 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:03.322952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:03.323707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:03.323945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:03.325511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:03.349688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:03.405945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:03.407426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:03.523391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 209/424] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:03.529297 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:03.562587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd472a-4bc2-49ac-ab09-f2808bf08c83 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:03.590254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:03.652432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a215f2-9188-42a9-84e7-a85322c0bd5f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:03.704352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:03.705707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:03.706193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:03.706634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:03.708051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:03.709671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:03.711826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 210/425] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:03 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:03.717196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:03.728632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a49d9b-00a2-4707-be60-5062bd805eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:03.729298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a49d9b-00a2-4707-be60-5062bd805eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:03.729623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a49d9b-00a2-4707-be60-5062bd805eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:03.729902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a49d9b-00a2-4707-be60-5062bd805eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:03.840770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ff79e-515f-40de-9168-d13f062ed80a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:03.856668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:03.886145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:03.887504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:03.888082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:03.888587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:03.890730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:03.892578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:03.894929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 211/426] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:03 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:03.913224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:04.056775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a49d9b-00a2-4707-be60-5062bd805eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:04.057892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9021c39-65fd-4fff-98ba-316a40d15d83 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:04.058276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a49d9b-00a2-4707-be60-5062bd805eb4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:04.084178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:04.107899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:04.109054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.109315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.111939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.111939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=4348185648f74543ae092c82e26979ee, scope.project.id=33b4d6311007470cb1808231ad28bd3a) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:04.112119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:04.115538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:04.135696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 212/427] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:31:03 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=4348185648f74543ae092c82e26979ee => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:04.328033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 216/428] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1117 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 12:31:04.332761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:04.412843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:04.475692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d0e428-c7fd-46be-b3a4-69b3a55faa84 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:04.493647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3652-80f3-4824-87e8-1b78862427ec None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.494496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3652-80f3-4824-87e8-1b78862427ec None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.494911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3652-80f3-4824-87e8-1b78862427ec None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.496644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 217/429] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:04.504541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.505043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.505621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.523156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:04.523156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.523156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.523156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] PATH_INFO: `/v3/projects/33b4d6311007470cb1808231ad28bd3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.524339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] RBAC: Authorizing `identity:get_project(project_id=33b4d6311007470cb1808231ad28bd3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:04.525946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:04.528464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 213/430] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:04 2022] GET /identity/v3/projects/33b4d6311007470cb1808231ad28bd3a => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:04.534933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:04.536153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:04.544955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:04.642288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 218/431] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:04.668833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:04.704248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250650b7-af65-44c7-b23e-bf8e9318186b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:04.723483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:04.727648 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:04.755534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:04.755534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.755534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.755534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.756680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:04.758292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:04.762024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 214/432] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:04 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:04.770282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:04.809917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571568c2-faee-4c8f-a447-77f7c6ed5976 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:04.865024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:04.865884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.866171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.866443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.890334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:04.900715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:04.901634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 12:31:04.902443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:04.909807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 219/433] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:04.914882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:04.937937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cdd68-51a7-473b-a86b-974dd4b64628 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:04.982087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:04.982737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.983182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.984220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:04.985332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=33b4d6311007470cb1808231ad28bd3a) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:04.985652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:04.987107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67ce191-0ae4-4f57-8bae-84516c9e4997 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:04.995280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 215/434] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:31:04 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=33b4d6311007470cb1808231ad28bd3a&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:04.996752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34e48-1593-4bc8-b9da-09c502bd524d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:04.997191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34e48-1593-4bc8-b9da-09c502bd524d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:04.997642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee34e48-1593-4bc8-b9da-09c502bd524d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.004634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 216/435] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:05.006354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a6254-0c9e-4dd8-b5d5-4f82f24f0ea6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.006808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a6254-0c9e-4dd8-b5d5-4f82f24f0ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.007082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a6254-0c9e-4dd8-b5d5-4f82f24f0ea6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.008719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 217/436] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:05.010111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.010550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.010968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.040641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:05.042106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:05.055687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.060404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d27869-5d5c-439e-8779-a6e8f338b3dd None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.102484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.109124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.112798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.113334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.113759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.114700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] RBAC: Adding query filter params (name=member) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:05.115163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:05.116755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c5739-dfd3-438f-83ab-b83356c15311 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:05.131548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 220/437] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:31:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:05.133482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.134004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.134409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.144119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 218/438] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:05.145032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.161912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:05.163449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:05.263649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 221/439] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:05.265835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.292332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d74e0-9651-40a6-ba59-e318e86b23bd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.350606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.352063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.352559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.353109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.396258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.411378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0a3e6-b136-48e1-8e2e-2b39ba6a0b77 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.425370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.464574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.464873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:05.466535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:05.466841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.467088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.467369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.486451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:05.502608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:05.503610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:05.504435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:05.506761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 222/440] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:05.507972 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.614610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 219/441] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:05.614610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.647644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed2b28-829c-42be-a68b-37a6120ba7fc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.688653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.689767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.692336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.692446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.704821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:05.705167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:05.713293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:05.728647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 223/442] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:05.729448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.730265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.730469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dc1ed-8d6b-4a49-ad46-471172e786b4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.771015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.771718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.772102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.772385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.773586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:05.773900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:05.775280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:05.785794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 220/443] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:05.786635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.824326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9e62c-6807-4fd2-8099-c8b6098071c2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.860800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.861711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.861993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.862273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.863477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:05.865004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:05.866647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 224/444] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:05.867597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.901131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc531510-32ba-4cfb-881c-8ec128c560d7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:05.937383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:05.938164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:05.938449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:05.938753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:05.939507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:05.939812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:05.941249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:05.948509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.951085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 221/445] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:05.952305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:05.959374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:05.981489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947d2b7-1f4e-4100-8f37-e4d4f922db98 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.017367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.018025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.018525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.018657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.064750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81e87-aab6-4475-961a-9bff6a96bce6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.092173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.094229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.109379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.110794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.111031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.111313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.112572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.114063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.115957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 222/446] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:06.116534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.189505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:06.191668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:06.217123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 225/447] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:06.219347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.224440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5be35-a7bd-41e4-88fd-2676d121dac2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.265411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.266062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.266341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.266613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.332173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef27fe8-09eb-4ad1-bd42-602456c56076 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.337944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.339403 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.370547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.371100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.371385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.371660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.373149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=cacd3e0b20764818bd998ab848b2a854, scope.project.id=719541d70431436ca6b3d21f00624cc1) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:06.373149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.374997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.381107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 226/448] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=cacd3e0b20764818bd998ab848b2a854 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:06.381916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.429823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:06.449228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:06.479999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 223/449] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:06.485317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.534835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e59d5-2701-4ed3-9d65-f8ec8f9ab818 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.592940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.594004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.594296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.594573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] PATH_INFO: `/v3/projects/008d6127b7814e42964dd897d624be5f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.598502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] RBAC: Authorizing `identity:get_project(project_id=008d6127b7814e42964dd897d624be5f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.599695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.601829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 227/450] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/projects/008d6127b7814e42964dd897d624be5f => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:06.607595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.647285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351329c3-d43b-4738-9c5b-fbc4ef7e8dd4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.706417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.706970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.707355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.707830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] PATH_INFO: `/v3/projects/719541d70431436ca6b3d21f00624cc1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.711005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] RBAC: Authorizing `identity:get_project(project_id=719541d70431436ca6b3d21f00624cc1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.713153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.714114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 224/451] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/projects/719541d70431436ca6b3d21f00624cc1 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:06.719649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.763235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf850b-c780-49ac-8a04-cdeed206328e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.772054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:06.779756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:06.807610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.808575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.808803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.809078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] PATH_INFO: `/v3/groups/4bf611b481b344788cb6f14176471d22` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.810268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] RBAC: Authorizing `identity:get_group(group_id=4bf611b481b344788cb6f14176471d22)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.812113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.813690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 228/452] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/groups/4bf611b481b344788cb6f14176471d22 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:06.819611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.850520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c0016-417e-4473-a6c0-71ca3e8f50d1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.889864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.890911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.891211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.891465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] PATH_INFO: `/v3/groups/49384188cc91443d9985a7efba5b4a8a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.892687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] RBAC: Authorizing `identity:get_group(group_id=49384188cc91443d9985a7efba5b4a8a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.894192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.900299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 225/453] 10.222.0.45 () {56 vars in 1180 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/groups/49384188cc91443d9985a7efba5b4a8a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:06.901514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:06.929411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a186-b1eb-4561-93e9-29d86b05ebd5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:06.967291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:06.968509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:06.968798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:06.969089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:06.969979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] RBAC: Adding query filter params (group.id=4bf611b481b344788cb6f14176471d22, role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=008d6127b7814e42964dd897d624be5f) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:06.970286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:06.971964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea94f0-cec7-4021-95d6-d1cf784abb8f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:06.979696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 229/454] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/role_assignments?group.id=4bf611b481b344788cb6f14176471d22&scope.project.id=008d6127b7814e42964dd897d624be5f&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:07.022237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb23c81-501b-404a-8421-38a51ed8b365 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:07.024952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:07.062438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:07.063120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:07.063401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:07.063670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:07.064588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] RBAC: Adding query filter params (group.id=49384188cc91443d9985a7efba5b4a8a, role.id=4348185648f74543ae092c82e26979ee, scope.project.id=719541d70431436ca6b3d21f00624cc1) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:07.064903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:07.066388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968bf6-6f25-4524-887a-4d2382f443f3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:07.076009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 226/455] 10.222.0.45 () {56 vars in 1376 bytes} [Mon Jul 25 12:31:06 2022] GET /identity/v3/role_assignments?group.id=49384188cc91443d9985a7efba5b4a8a&scope.project.id=719541d70431436ca6b3d21f00624cc1&role.id=4348185648f74543ae092c82e26979ee => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:09.979588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a187-0e43-47dc-80a4-022404e76bb4 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:09.980094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a187-0e43-47dc-80a4-022404e76bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:09.980094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242a187-0e43-47dc-80a4-022404e76bb4 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:09.981776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 230/456] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:09.986911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347ee7-0ba9-4060-b5dc-73bca71447e2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:09.987351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347ee7-0ba9-4060-b5dc-73bca71447e2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:09.987471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd347ee7-0ba9-4060-b5dc-73bca71447e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.029017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd347ee7-0ba9-4060-b5dc-73bca71447e2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:10.030767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd347ee7-0ba9-4060-b5dc-73bca71447e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:10.134415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 227/457] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:10.175338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242a187-0e43-47dc-80a4-022404e76bb4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:10.192706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6202fa3-71c0-48bf-9f16-fbc11af6f3c5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.193334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6202fa3-71c0-48bf-9f16-fbc11af6f3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.193774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6202fa3-71c0-48bf-9f16-fbc11af6f3c5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.195624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 228/458] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:10.200682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a124-9b9f-4945-adc9-5338f717a3fd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.201226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a124-9b9f-4945-adc9-5338f717a3fd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.201501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9a124-9b9f-4945-adc9-5338f717a3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.242830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9cc9a124-9b9f-4945-adc9-5338f717a3fd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:10.244823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9cc9a124-9b9f-4945-adc9-5338f717a3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:10.267167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:10.382083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242a187-0e43-47dc-80a4-022404e76bb4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:10.394677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 229/459] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:10.396410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cf07-cdee-43a9-ac5d-86bbdd9550ec None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.396698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cf07-cdee-43a9-ac5d-86bbdd9550ec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.396970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cf07-cdee-43a9-ac5d-86bbdd9550ec None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.398231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 230/460] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:10.404497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.407976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.407976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.432188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:10.433423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:10.445187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:10.446491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.446491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.446491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.459059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:10.459783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:10.460649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:10.482631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:10.484384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:10.485682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:10.485682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:10.485682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:10.485682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:10.485682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 231/461] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:10.486032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:10.514132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 231/462] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:10.521988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:10.599365 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:10.606164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e9647-7311-44ca-bfd8-aa1669fab334 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:10.653044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a36b7c-9946-49fb-8f49-eb6f3ab87349 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:10.657198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:10.658007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.658285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.658556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.680709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:10.682291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:10.700549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:10.701522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.702042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.702601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.703547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:10.704157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:10.705749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340c21e-5757-45f3-bcb4-a2dfce992825 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:10.714961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:10.715889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:10.716775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:10.716775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:10.716775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:10.716775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:10.719754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 232/463] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:10.719754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:10.738624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 232/464] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:10.740549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066de5-44e9-4a84-8699-70cc8970f1c1 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.740840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066de5-44e9-4a84-8699-70cc8970f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.741112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96066de5-44e9-4a84-8699-70cc8970f1c1 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.742667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 233/465] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:10.747441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96066de5-44e9-4a84-8699-70cc8970f1c1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:10.772213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:10.845835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e80e6-a85c-4dd2-bdc3-3dc702e35e51 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:10.884369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96066de5-44e9-4a84-8699-70cc8970f1c1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:10.892532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:10.893888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.894241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.894529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.910703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:10.913200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:10.921317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:10.934197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:10.935286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:10.940962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:10.940962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:10.940962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:10.940962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:10.940962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 233/466] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:10.940962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:10.949566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:10.950423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.950903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.952309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:10.953515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:10.953837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:10.955629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723da6e-c8a4-450f-9326-3562b7c2dedb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:10.972488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 234/467] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:10.973790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:10.974082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:10.974362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.014147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:11.015391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:11.073544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52a29d-1363-4612-b3a5-e8a106b3cf91 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:11.125451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:11.126285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.126670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.127052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.127887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:11.129660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:11.137975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 235/468] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:11.140796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:11.158744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:11.255591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 234/469] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:31:10 2022] POST /identity/v3/users => generated 246 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:11.256708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:11.275661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c6424-e00b-4a1f-a40a-18370905953c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:11.329573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:11.330211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.330491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.330807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.331603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:11.331933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:11.333930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:11.348511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 236/470] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:11.349391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:11.454474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:11.503488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:11.531234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87d999-b264-4f21-b40a-ea1c91624220 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:11.540318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7192d1-eb1a-42af-8d55-58f2709d9c9c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:11.582326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:11.583567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.584015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.584676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.585549 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:11.588144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:11.598575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:11.599657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.602249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.602249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.617266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:11.619119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:11.639978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:11.640965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:11.641804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:11.641804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:11.641804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:11.641804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:11.641804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 237/471] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:11.641804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:11.711946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 235/472] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:31:11 2022] POST /identity/v3/users => generated 248 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:11.711946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:11.857209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe868e-b1b9-47f3-9c39-fbdfabe97d82 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:11.901996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd49963-8581-4cd2-864d-b8f02a7aa8e5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:11.908781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:11.922727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:11.947545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd5eb0-e485-43f3-aae3-2961057a1ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:11.948337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5eb0-e485-43f3-aae3-2961057a1ecc None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.949804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5eb0-e485-43f3-aae3-2961057a1ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.950087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd5eb0-e485-43f3-aae3-2961057a1ecc None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.950856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd5eb0-e485-43f3-aae3-2961057a1ecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:11.953349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd5eb0-e485-43f3-aae3-2961057a1ecc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:11.963150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:11.964272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.965176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.965685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.966665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:11.967147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:11.969489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b39f5-276e-43bd-a0e5-753e1c815b5b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:11.986222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 236/473] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:11.994182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82047683-30dd-4974-9ae5-900b945f73de None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:11.994182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82047683-30dd-4974-9ae5-900b945f73de None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:11.994182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82047683-30dd-4974-9ae5-900b945f73de None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:11.994182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 237/474] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:11.994182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82047683-30dd-4974-9ae5-900b945f73de None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:12.074959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 238/475] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:31:11 2022] POST /identity/v3/users => generated 248 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:12.079942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:12.079942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:12.079942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:12.126132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:12.128202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:12.251020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82047683-30dd-4974-9ae5-900b945f73de None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:12.334791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 239/476] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:12.344658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:12.345352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:12.345639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:12.345933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:12.346653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:12.348221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:12.375751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:12.475576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 238/477] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:31:11 2022] POST /identity/v3/users => generated 249 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:12.587179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a9ca-5c77-4935-82fa-a1489451633d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:12.600072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:12.659172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:12.659881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:12.661098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:12.662658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:12.665350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:12.666809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:12.709144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 12:31:12.709144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 12:31:12.709144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [parameters: {'id': 'dbcf5025558742c8afd5758306a9cef5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 12:31:12.709144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 25 12:31:12.731015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:31:12.731908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 12:31:12.732956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:31:12.734153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:31:12.735032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:31:12.735869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'id': 'dbcf5025558742c8afd5758306a9cef5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:12.738755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 12:31:12.740795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:12.745687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 240/478] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Jul 25 12:31:12 2022] POST /identity/v3/roles => generated 144 bytes in 370 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:12.760050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:12.817293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:12.918784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba560f18-079d-43bf-9c79-ceb045d77a4e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:12.994990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed77b4-8ea6-4035-83db-30eb89c21c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:12.995835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed77b4-8ea6-4035-83db-30eb89c21c7d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:12.996908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed77b4-8ea6-4035-83db-30eb89c21c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:12.996908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed77b4-8ea6-4035-83db-30eb89c21c7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:13.014565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed77b4-8ea6-4035-83db-30eb89c21c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-cbed77b4-8ea6-4035-83db-30eb89c21c7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:13.023698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:13.024633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:13.025850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 239/479] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:13.032199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:13.291903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdf9d-2844-4eee-b962-2225583e5e1e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:13.341785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:13.342732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:13.343021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:13.343301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:13.344087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:13.344402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:13.345776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c3a01-d8f7-4858-9497-0e2990d4f706 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:13.358252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 241/480] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:13.633514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f672f4-461a-4603-8f24-ff3e90df7187 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:13.634472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f672f4-461a-4603-8f24-ff3e90df7187 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:13.634963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f672f4-461a-4603-8f24-ff3e90df7187 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:13.636865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 240/481] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:13.645121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:13.645413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:13.645696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:13.666314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:13.667809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:13.699902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:13.757244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 242/482] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:13.783729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f672f4-461a-4603-8f24-ff3e90df7187 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:13.894716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:13.915701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f672f4-461a-4603-8f24-ff3e90df7187 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:13.964749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:13.965550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:13.965833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:13.966111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:13.987689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:13.995804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:13.996710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:13.997717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 241/483] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:14.004199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:14.207696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c138a9-bd67-48a0-b444-c92d3f04c241 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:14.254671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:14.255359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.255646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.255947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.256710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:14.257018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:14.259732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881a20e-f577-4a43-bed8-0fcf5c1ef54b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:14.269372 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 243/484] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:14.281280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:14.313559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066c0e-7209-4566-be25-07e1c4bb2acf None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.315029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066c0e-7209-4566-be25-07e1c4bb2acf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.315317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2066c0e-7209-4566-be25-07e1c4bb2acf None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.319324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 244/485] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:14.323214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.323341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.323618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.389580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:14.390818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:14.421442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:14.559119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 245/486] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:14.597329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:14.627144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139adef4-f94b-43fa-bf90-6413331523ba None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:14.695296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:14.696170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.696450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.696721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.718701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:14.720877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:14.730607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:14.753006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87628a29-cfd6-4bb0-ae79-81243eec1e12 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-13782ad5-f5cd-4bb9-83ae-42a22df235d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:14.754579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:14.755398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:14.756279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:14.756279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:14.756279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:14.756279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:14.759388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 242/487] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:14.764369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bedabd-0a97-4641-8710-ca6b08ca826e None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.764887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bedabd-0a97-4641-8710-ca6b08ca826e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.765478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bedabd-0a97-4641-8710-ca6b08ca826e None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.767300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 243/488] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:14.768551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bedabd-0a97-4641-8710-ca6b08ca826e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:14.789804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbafd13-85a1-4214-98a1-8593ddbe9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:14.790597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbafd13-85a1-4214-98a1-8593ddbe9169 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.790879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbafd13-85a1-4214-98a1-8593ddbe9169 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.791398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbafd13-85a1-4214-98a1-8593ddbe9169 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.803299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbafd13-85a1-4214-98a1-8593ddbe9169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3cbafd13-85a1-4214-98a1-8593ddbe9169 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:14.811402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:14.812327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:14.813104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:14.815890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 246/489] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:14.817285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.817731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.818169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.837199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:14.838653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:14.849538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:14.899027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bedabd-0a97-4641-8710-ca6b08ca826e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:14.911038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 247/490] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:14.912233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:14.933723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:14.934732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:14.935214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:14.935785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:14.936850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:14.937357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:14.938958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:14.955618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 244/491] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:14.956515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.018469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.022819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9f896-203f-4f00-8eb5-be3ca6ec244e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.059841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.061262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6bbc-e2cf-40cf-a8ae-e12722475ce4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.061617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.062177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.062595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.064455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:15.067192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.067192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.076190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 248/492] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:15.078069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.089145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.098519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.099379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.099683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.099981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.112237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:15.120861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:15.121839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 245/493] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:15.123493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.199216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afa767-bea4-4ab9-bf8f-bc0122fd228d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.228908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4b240-77d3-4867-99fa-d1c0c9fbe424 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.236799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.238001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.238478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.238961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.246384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.249531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.251280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.264875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.265750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.266031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.266302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:15.269870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:15.270738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:15.271630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:15.274416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 249/494] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:15.275398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.283148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.284687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:15.304491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:15.305380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:15.306830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:15.306830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:15.306830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:15.306830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:15.306830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 246/495] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:15.306830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.352450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.395759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10218e-bd6d-4387-a066-fc58d2bd9bea None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.412807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c62ddd-b245-4f28-9e95-408b6061d6c7 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.435379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.436265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.436572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.436819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.437566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:15.437870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.439303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.447532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.448237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.448522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.448795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.449634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:15.449945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.451910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c70f-7ca6-427f-bc26-4bca2e73c6a3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.453206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 250/496] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:15.454062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.495953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 247/497] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:15.495953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a175-fc08-40eb-92e1-6c674556c86f None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.495953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a175-fc08-40eb-92e1-6c674556c86f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.495953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1a175-fc08-40eb-92e1-6c674556c86f None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.495953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 248/498] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:15.495953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a175-fc08-40eb-92e1-6c674556c86f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.525660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.570660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd87557-1fc4-4839-81dd-119d88092b03 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.600116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.603594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1a175-fc08-40eb-92e1-6c674556c86f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.608882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.609544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.609823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.610096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.612416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:15.612416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.613417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.632245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 251/499] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:15.632953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.644816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.645938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.646229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.646665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.658361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.660102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-1a2b7ec1-52b4-446a-a8fc-0d71aa65b0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:15.678100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:15.678994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:15.680475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:15.680475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:15.680475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:15.680475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:15.680475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 249/500] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:15.681134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.681134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.681416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.704124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:15.705318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:15.752586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630343-c767-4d84-9a72-f206436610d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.787530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 250/501] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:15.787530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.800252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.808161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.812526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.812526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.812526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.868974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:15.882613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.884205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.893786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cabe8f-0ba5-4af3-a4cf-025d9163b882 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:15.928280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:15.929075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:15.929355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:15.929624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:15.937289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:15.938740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:15.954704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:15.955669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:15.956633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 251/502] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:15.957814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:15.992220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 252/503] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:15.993081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.034818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.065042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74bfbe-3ae1-495e-bd2c-83c773a94e2c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.082107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.095574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff541b-35da-49ff-9543-d93d73069900 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.099257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.099937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.100229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.100502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.101219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:16.101525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.102910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.115492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 252/504] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:16.116331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.131849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.132778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.133067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.133345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.144401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:16.152212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:16.153127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:16.153968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 253/505] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:16.155291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.213897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a21f5-1b11-449d-9465-6ca46646e2b0 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.241271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.246993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.247648 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.252963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.252963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.252963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:16.252963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.252963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd4ca2-ea97-4bf0-b234-71b42991c374 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.258332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c2559-ebda-484d-88bd-ef7159411c4f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.268893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 253/506] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:16.270473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676a588-6923-425d-aa72-8be849c55a75 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.270757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676a588-6923-425d-aa72-8be849c55a75 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.271031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676a588-6923-425d-aa72-8be849c55a75 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.272284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 254/507] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:16.274219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676a588-6923-425d-aa72-8be849c55a75 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.294402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.295300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.295578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.295842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.306082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.307533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.315573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:16.324893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:16.328672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:16.329508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:16.329508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:16.329508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:16.329508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:16.329508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 254/508] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:16.329508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.380585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676a588-6923-425d-aa72-8be849c55a75 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.414672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.415395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.415681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.415976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.423524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.425017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.426068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af7134-351f-40b1-ac1c-0c47e7c75b34 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:16.440074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:16.440996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:16.441901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 255/509] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:16.442487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.464020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.464689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.464976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.465256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.466004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:16.466320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.468581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61f7e4-f952-4657-9560-68276697338c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.476501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 255/510] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:16.477680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.477975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.478271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.496122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:16.496533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.497414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:16.552397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4945c-eaf8-4f34-a2e6-96a84f603335 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.556086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.566814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 256/511] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:16.567629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.587912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.588581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.588863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.589135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.656261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.657724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.665562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c272e7-fc42-4d93-82e5-49938681eeab None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.699885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.700645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.700934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.701211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.701937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:16.702242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.703614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.707174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.714666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 257/512] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:16.715467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.760002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 256/513] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:16.760843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.770251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.817598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac77761-c566-4a64-b74b-2ef7cffed9b2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.850462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.851132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.851413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.851687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.852560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:16.852874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.854297 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.856518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0e672-15ec-4082-99d9-0074d7d1180a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:16.890284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:16.891068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:16.891351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:16.891543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 258/514] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:16.891705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:16.892461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.904902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:16.906487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:16.914659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:16.930987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:16.931829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:16.932728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:16.932728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:16.932728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:16.932728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:16.932728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 257/515] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:16.932728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:16.990614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35117-3f13-43ce-80f2-1e347735b425 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.001274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.024369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.025153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.025428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.025521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34658bbe-d6d5-49bb-99e1-38ae56534b32 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.025697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.036303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.037874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:17.056141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:17.057773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:17.059727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:17.059727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:17.059727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:17.059727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:17.059727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 259/516] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:17.059727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.064989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.066132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.066132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.066293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.073162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.074606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:17.089067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:17.089932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 258/517] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:17.100586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.162988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9fa85-5752-4471-aee6-fc5d541e46e3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.165915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.200119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.200837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.201633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.201908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.205408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46849018-3e4a-4d2d-9a79-2e68044f093f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.212426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.213881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:17.231572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:17.232536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:17.233401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:17.233401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:17.233401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:17.233401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:17.233401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 260/518] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:17.233677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.243067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.244006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.244291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.244567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.251284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.310078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.313351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.335061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04426e74-02bd-4d2e-b9d0-6df732843fa0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.369025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.369292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.369948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.370235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.370509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.371220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:17.371527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.372929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.385290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 261/519] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:17.386102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.415154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 259/520] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:17.416331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.470551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.494665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10066195-5d9a-4de7-b622-d62163f1cfef None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.514750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e4fb6-806f-40b9-aab0-19adc038dc03 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.531950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.532617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.532906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.533190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.533910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:17.534235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.535600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.549566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 262/521] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:17.550363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.555765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.556463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.556747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.557030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.557822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:17.558132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.559572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.580916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 260/522] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:17.581971 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.604392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.657230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595e83-3fec-4a44-a72d-31ad7c649e5d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.695064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004934f-adf2-4e7f-8731-f014f511544a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.696855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.697514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.697792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.698068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.698781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:17.699082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.700535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.702756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.713443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 263/523] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:17.714467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.735663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.736491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.736773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.737041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.744519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.745974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:17.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:17.763428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:17.765109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 261/524] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:17.765701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.834139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a322b-9308-4430-bcf3-0272aee928e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.853954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.874097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8ff40-2a18-47e6-aca9-50417fe1fe30 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:17.874887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.876864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.876864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.876864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.889378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.891018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.908824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836924-f743-4784-be55-a192310ac520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:17.909032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:17.909854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:17.910790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:17.910790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:17.910790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:17.910790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:17.911022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836924-f743-4784-be55-a192310ac520 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:17.911022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836924-f743-4784-be55-a192310ac520 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:17.911022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20836924-f743-4784-be55-a192310ac520 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:17.911192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 264/525] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:17.911256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836924-f743-4784-be55-a192310ac520 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:17.911330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:17.912429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20836924-f743-4784-be55-a192310ac520 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:17.966355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:17.988389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 262/526] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:31:17 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:17.989145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836924-f743-4784-be55-a192310ac520 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.035659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf890d6-13dd-4f91-9143-90948f5148da None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.077228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.077969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.078256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.078530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.079503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=62eba0e2bd914eeb949bb434f8a6cd9c) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:18.079842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.081429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.088154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 265/527] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/role_assignments?user.id=62eba0e2bd914eeb949bb434f8a6cd9c&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:18.097334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.133737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20836924-f743-4784-be55-a192310ac520 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.186247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.188216 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.189014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.189477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.194528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:18.202458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.203996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:18.224732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:18.225762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:18.226593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:18.227003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 263/528] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:18.228851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.250581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06759a-5d13-4de5-b7b0-eaeb575c938c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.263417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:18.298579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.299274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.299544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.299815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.301200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:18.301804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.303461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.328916 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 266/529] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:18.329803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.366561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfa3b1-f4cf-45fb-baf5-132a02a72ff2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.411145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.411816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.412128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.412562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.413792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:18.414108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.415822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.430876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 264/530] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:18.431606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.461927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904af7a-9e65-4c77-a48a-c01de8b3ce11 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.507585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:18.511930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.512627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.512910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.513195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.514033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:18.514343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.515811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.535054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 267/531] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:18.535967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.562205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff051a-8d52-435c-8280-c8ef4433524c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.566346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:18.602203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.602949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.603238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.603515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.643239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d2f91-3d56-426f-83fd-eb675e97166e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.679604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.680434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.680778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.681059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.688123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.693454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.694879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.695005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:18.710640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:18.711550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:18.712442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 268/532] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:18.712915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.762322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:18.805467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:18.816354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 265/533] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:18.817470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.823222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643166c6-9c0d-41b5-8cec-e16c59979fb2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.858699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.859507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.859896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.860333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.861288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=06abb3c5b9f842fca49b9a44e7feb99d) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:18.861976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.863753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:18.870847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 269/534] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/role_assignments?user.id=06abb3c5b9f842fca49b9a44e7feb99d&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:18.871776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:18.949640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0aa1d-46b4-4773-a09a-57a44bdaeb00 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.980908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1804c5-4fe0-4574-b17f-e06b38597e36 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:18.990888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:18.991887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:18.992474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:18.992945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:18.994305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:18.994840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:18.996558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.015708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 266/535] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:19.017422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:19.019971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:19.020872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:19.021228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:19.021575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:19.033378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:19.034842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.040618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:19.054524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:19.056422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:19.057514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:19.057514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:19.057514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:19.057514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:19.057514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 270/536] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:19.062275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:19.066345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:19.140487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc0a2-8b8f-44d6-bee2-e68848ae259d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:19.170732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b1d3-a2be-4ac5-93e9-831e2495750f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:19.181456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:19.182233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:19.182519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:19.182801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:19.183637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=750b39980ed14876879b80fe6ca61482) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:19.183979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:19.186640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.199694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 267/537] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:19 2022] GET /identity/v3/role_assignments?user.id=750b39980ed14876879b80fe6ca61482&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:19.207161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:19.207847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:19.208164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:19.208442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:19.209197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:19.209504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:19.210934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.225197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 271/538] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:19.230981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:19.352482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:19.375948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14aca08-8727-4923-93e2-15f2e41cb2a8 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:19.418676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:19.419503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:19.420425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:19.420876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:19.431521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:19.433064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:19.449708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:19.452237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:19.454309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 268/539] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:19.458037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:19.554001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:19.603382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61988eca-53d7-4a14-bf9a-8653a11479dd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:19.651930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:19.652594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:19.652873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:19.653144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:19.653934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:19.654808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:19.656266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee176f-1947-4b46-952c-f26f264df225 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.679323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 272/540] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:19.688294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:19.849268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e9071-9e0d-4d89-89a3-e53fbcb41a04 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:19.899058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:19.899646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:19.899946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:19.900233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:19.901068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=8996a1cff4474efeac1878197b5c07b2) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:19.901386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:19.902821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a7b75-db03-4994-b5c3-9e6bebd77f93 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:19.909359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 269/541] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:19 2022] GET /identity/v3/role_assignments?user.id=8996a1cff4474efeac1878197b5c07b2&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:20.405406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a79f4-f70d-440e-967f-b592ad70178f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:20.405805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a79f4-f70d-440e-967f-b592ad70178f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:20.405979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a79f4-f70d-440e-967f-b592ad70178f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:20.407591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 273/542] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:20.413143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038657d-8fe0-4439-892c-f29dae2ccbdd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:20.413433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038657d-8fe0-4439-892c-f29dae2ccbdd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:20.413720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038657d-8fe0-4439-892c-f29dae2ccbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:20.421507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:20.444941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9038657d-8fe0-4439-892c-f29dae2ccbdd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:20.446171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9038657d-8fe0-4439-892c-f29dae2ccbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:20.530104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 270/543] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:20.570411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a79f4-f70d-440e-967f-b592ad70178f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:20.582234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be2e81-32bc-403d-bf6e-d42ec3ead9f2 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:20.582522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be2e81-32bc-403d-bf6e-d42ec3ead9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:20.582799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be2e81-32bc-403d-bf6e-d42ec3ead9f2 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:20.588973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 271/544] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:20.593832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:20.594445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:20.594927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:20.614786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:20.616460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:20.701977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a79f4-f70d-440e-967f-b592ad70178f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:20.752106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:20.779140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 272/545] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:20.779933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c255c-303c-4337-a567-05701939dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:20.780767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c255c-303c-4337-a567-05701939dcbb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:20.781046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c255c-303c-4337-a567-05701939dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:20.781318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c255c-303c-4337-a567-05701939dcbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:20.803858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:20.818706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c255c-303c-4337-a567-05701939dcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-659c255c-303c-4337-a567-05701939dcbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:20.827544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:20.828509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:20.829298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:20.839706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 274/546] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:20.844053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c255c-303c-4337-a567-05701939dcbb None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:20.917341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:20.975899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c255c-303c-4337-a567-05701939dcbb None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.013351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4278be-5c0f-4342-b188-28c54027722a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.014061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.014813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.015162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.015506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.019941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:21.019941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.019941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.028516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 275/547] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:21.034433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.079015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.079823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.080360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.080641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.103638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:21.113927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:21.114882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:21.115683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 273/548] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:21.121179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.121910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.177032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e86889-a059-4c83-b1f8-78af2aed2f28 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.213654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.214844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.215323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.215811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.227855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.229582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:21.248326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:21.249282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:21.250129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:21.250129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:21.250129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:21.250129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:21.252144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 276/549] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:21.257515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.337761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6d4fc-677a-4cae-8a03-9b2b7826cef9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.360664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.364717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5ba05-0482-41d8-a504-be85103f679d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.368890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.383977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.384960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.385302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.385633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.388888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:21.388888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.388888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d025-84ab-4004-87df-85a50f2edd8d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.400392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 274/550] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:21.402780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5949-b881-4978-8f9a-1beb07ded444 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.403821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5949-b881-4978-8f9a-1beb07ded444 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.405060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5949-b881-4978-8f9a-1beb07ded444 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.407331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 275/551] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:21.408750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5949-b881-4978-8f9a-1beb07ded444 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.409795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.410452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.410731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.411003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.411723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:21.412052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.418895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091058b-8a06-4daf-b8df-0d28d7e40693 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.427514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 277/552] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:21.428842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.429125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.429397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.450934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:21.452387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:21.530884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 278/553] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:21.530884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.552141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5949-b881-4978-8f9a-1beb07ded444 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.610263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.611672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.612409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.613247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.616207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.629090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64358ec-ee0d-4e6c-b391-e33506a1903e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.630107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.632683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:21.655464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:21.656440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:21.657501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:21.657501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:21.657501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:21.657501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:21.659064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 276/554] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:21.659987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.664951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.665590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.665869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.666143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.674576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.676113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:21.693849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:21.694762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:21.695682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 279/555] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:21.696514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.710594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.775478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0df15-58f1-4535-8b55-46f13ce08e0a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.811647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.812763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.812871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac3a55-c781-4912-80f0-cac6709a5cb1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.813334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.813781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.824638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:21.832766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:21.833723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:21.834540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:21.837100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 277/556] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:21.838030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.850528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.851188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.851470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.851746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.852508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:21.852818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.854209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae33b8-82bb-47a2-bf3c-5a316c780973 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:21.866557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 280/557] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:21.867826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fb97-388f-493b-a3f1-b39deb07668b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.868142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fb97-388f-493b-a3f1-b39deb07668b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.868672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475fb97-388f-493b-a3f1-b39deb07668b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.872037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 281/558] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:21.872037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fb97-388f-493b-a3f1-b39deb07668b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:21.883934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.946956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:21.950664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99121356-7448-4d31-8018-fce0e712c44d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.978835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475fb97-388f-493b-a3f1-b39deb07668b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:21.987055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:21.987734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:21.988383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:21.988684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:21.989841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:21.990161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:21.991779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.014620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 278/559] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:22.014620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.020691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.021364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.021652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.021930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.022685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:22.023222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.024389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848f834-6b6d-455c-b837-9eeb1499d53a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.033492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 282/560] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:22.037700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.038376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.038841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.056890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:22.058392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:22.119867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989809-35eb-4b8a-9e69-f19f600200d1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.134587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.139613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 283/561] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:22.152783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.156139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.157541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.157541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.157541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.165521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.167014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:22.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:22.184230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 279/562] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:22.185309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.207988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.263049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765fc4f-8256-4e4b-b23d-cedd5754cf18 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.298061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030c9f-0119-4f37-b83d-e13f9da3037b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.303521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.304459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.304945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.305963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.331938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.332741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.333021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.333293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.343458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.344937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:22.362509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:22.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:22.369975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:22.369975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:22.369975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:22.369975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:22.369975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 280/563] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:22.369975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.372163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.375853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.377328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.429073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.461053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f0d2-b29d-41b2-ad0f-2e8e89bd6005 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.473877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 284/564] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:22.474728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.500562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f440-6b42-4588-9c7a-8c01657d4b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.501358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f440-6b42-4588-9c7a-8c01657d4b18 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.501667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f440-6b42-4588-9c7a-8c01657d4b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.501943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f440-6b42-4588-9c7a-8c01657d4b18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.511742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636f440-6b42-4588-9c7a-8c01657d4b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-2636f440-6b42-4588-9c7a-8c01657d4b18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:22.519443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:22.520427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:22.521283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 281/565] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:22.521984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208973-7e7b-4644-84dd-3645a7bf75f5 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.522184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208973-7e7b-4644-84dd-3645a7bf75f5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.522443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86208973-7e7b-4644-84dd-3645a7bf75f5 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.523695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 282/566] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:22.524419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208973-7e7b-4644-84dd-3645a7bf75f5 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.576075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.579058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cd887-6f2f-47fe-83cd-9dee8b9c6d74 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.613743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.614514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.614792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.615066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.615885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:22.616217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.617630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.627509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86208973-7e7b-4644-84dd-3645a7bf75f5 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.635265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 285/567] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:22.636086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.654427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.662119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.662844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.663133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.663413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.664165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:22.664472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.665836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.677321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 283/568] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:22.678121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.736629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94756e9-19a3-45f9-974d-6f00172798a5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.770180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.770984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.771237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.771647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.784367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.786025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.791498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149945dc-af17-4b62-a56c-c2b02c5376de None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4e158a61-1ff2-47df-a954-34bb06b6eacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:22.803284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:22.804283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:22.805190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:22.805190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:22.805190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:22.805190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:22.805190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 286/569] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:22.805650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.805929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.806195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.824131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:22.825304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:22.828809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.831473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.832165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.832441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.832712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:22.833443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:22.833744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:22.835112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:22.843334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 284/570] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:22.851770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.892348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 287/571] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:22.893192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:22.907248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:22.956935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6920c-82ab-4682-878f-0cb1fd328ed3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.989435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:22.990181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec6a73-0bcc-409e-855b-e82dbfe5cdd3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:22.990285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:22.990493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:22.990767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.002159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.003625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:23.020754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.021720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.022692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:23.022692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:23.022692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:23.022692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:23.022692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 285/572] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.022692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.028337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.029728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.031824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.031824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.037565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.038982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.041572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:23.053840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.058245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 288/573] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.059435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.130416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623f7cb-db10-4d1d-9dec-005504424ce3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.131936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.176161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812385-6892-42a9-b29a-0794d44bef8a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.178067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.178728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.179005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.179278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.180020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:23.180328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.181755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.193222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 286/574] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:23.194007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.210150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.210942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.211223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.211497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.222389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.223957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:23.241938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.242995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.244278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:23.244278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:23.244278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:23.244278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:23.244278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 289/575] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.244278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.296130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d0413-cbbb-41c4-afe4-a89b72629da1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.297153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.329329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.330117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.330386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.330655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.340695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:23.341211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f826c-d696-41fe-99ad-5786b8778689 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:23.349060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.349947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:23.350800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 287/576] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.351494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.380047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.381913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.382563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.382842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.383115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.383820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:23.384148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.385546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.396694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 290/577] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:23.397475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.458020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3aa16-bb67-4ab8-834e-6fbb0a931087 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.490555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.491213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.491492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.491761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.492610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:23.492915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.494598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.494870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b390b3-54f9-4fc4-bc84-d3b6b52f7a66 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.507290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.511567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 288/578] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:23.512324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.528012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.529309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.529654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.529930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.536592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.538028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:23.553052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.553934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:23.554832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 291/579] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.555314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.594701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.613472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6186e8-e775-4d2b-87d8-cb4c02d2c83f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.647743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.648424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.648702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.648980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.649689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:23.649992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.651360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.651638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d68086-57e1-4fad-a24a-71ccd4c0ce33 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.662786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 289/580] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:23.663651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.687776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.688335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.688622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.688891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.689635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:23.689945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.691302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.699302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 292/581] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:23.700106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.733469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.769642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738a887-a7d8-42b7-b0e4-9be941230efe None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.798355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be4b0-6d94-4b68-88b0-09fc21470f13 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.803327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.804542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.804846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.805118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.812523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.813977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.816502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:23.828627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.829603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:23.830513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 290/582] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.831029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.836839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.837653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.837931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.838234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.848411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.849865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:23.867590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:23.868806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:23.869677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:23.869677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:23.869677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:23.869677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:23.869677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 293/583] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:23.869956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:23.936537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6851fc-656e-48df-b662-04a37f5721ee None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.953717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:23.967654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041907b-4e61-4c5d-8cb8-bde943b67c85 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:23.969858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:23.970510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:23.970786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:23.971056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:23.971831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:23.972165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:23.973584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:23.985607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 291/584] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:23.986336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.001352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.002137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.002414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.002686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.009620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.011038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:24.024867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:24.025806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 294/585] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:24.026757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.049293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.091423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8cbb9-8394-499d-97da-eefcfcb24cf6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.141505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180f0d9-3deb-4a0e-99ea-2ab4476da40d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.143221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.144040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.144321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.144590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.154884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.156367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:24.173172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:24.174083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:24.174997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:24.174997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:24.174997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:24.174997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:24.175228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.175228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.175228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.175438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 292/586] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:24.175509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.175585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.175655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:24.175655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.177007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.189691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 295/587] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:24.190555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.200491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.277726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db3e0e-9108-44fd-af4a-4fc3e90cefef None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.288966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716ca5-03ef-414f-adf2-90f7cf8361c9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.290574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.312343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.313048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.313333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.313608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.314322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:24.314629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.316024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.322906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.323549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.323831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.324136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.324954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=137aecde49064a4abf74de30e9a85875) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:24.325265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.326909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.327649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 293/588] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:24.328527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.332916 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 296/589] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/role_assignments?user.id=137aecde49064a4abf74de30e9a85875&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:24.333578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.416213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.451092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f257dc4-73d8-4e08-82cc-f77c2b1ec55d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.464569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a44ae-4a56-4148-83cb-20eddeb8f286 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.487846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.488559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.488841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.489114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.490598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:24.491259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.492874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.504461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.505167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.505454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.506379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.506565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:24.506880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.507020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 297/590] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:24.507760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.512512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.533563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 294/591] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:24.534426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.567415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.619759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95689-360f-4761-9ec0-10f14c0028cc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.641172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35997b35-547f-4786-bc73-ac8f991c6450 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.650132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.658067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.658964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.666093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.666093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/62eba0e2bd914eeb949bb434f8a6cd9c/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.675934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=62eba0e2bd914eeb949bb434f8a6cd9c, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.677377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.678231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.679035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.679313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.679590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.689249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.694332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:24.705666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:24.706621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:24.707518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 295/592] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:24.708520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.759318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 298/593] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:24 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/62eba0e2bd914eeb949bb434f8a6cd9c/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:24.760598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.826688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:24.841550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312ba3-ea31-4000-a8bf-576c33e7a9df None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.887574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.889009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.889293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.889569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.890649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f8633-2a3a-4e6d-b918-f57299ab21e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:24.898762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.900288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:24.916468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:24.917693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:31:24.918963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:24.923107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 296/594] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:24.924134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:24.946107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:24.947323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:24.947807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:24.948349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:24.961154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:24.963112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:24.983600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:24.984745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:24.985646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:24.985646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:24.985646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:24.985646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:24.987267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 299/595] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:24.988460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.026783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.044819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d923876-455f-4927-b903-9f4d9284f9e8 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.082831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.083583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.084061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.084374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.085264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:25.085672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.087199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.103956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 297/596] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:25.103956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.115017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e50a83-6e67-4b5e-a7fb-4c786a4e3715 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.120801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.159215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.160093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.160472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.161198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.162409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:25.162820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.164531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.186897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 300/597] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Jul 25 12:31:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:25.188146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.234301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d19b-fd95-4e3b-ac6c-9128a21fb2ce None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.276995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.277902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.278339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.279427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.280953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:25.281440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.283342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.298520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.303823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 298/598] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:25.303823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.315533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32d178-a94a-468f-8626-adf4a093cdb4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.358608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.359886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.360318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.360902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/06abb3c5b9f842fca49b9a44e7feb99d/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.381406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=06abb3c5b9f842fca49b9a44e7feb99d, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.383152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.393734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.426569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c699b2-ab20-496f-8043-b96c9c918d50 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.451575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 301/599] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:25 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/06abb3c5b9f842fca49b9a44e7feb99d/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:25.454027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.492881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.495032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.495316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.495590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.523349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.527230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:25.566608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:25.567582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:25.568521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:25.568521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:25.568521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:25.568521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:25.572126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 299/600] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:25.580990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.629161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ae434-698b-4d60-9db9-d2dea169980d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.675047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.675852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.676203 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.676436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.697187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.699803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:25.720343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:25.721381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:25.722415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:25.725111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 302/601] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:25.729856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.730855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.738281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb1175-d8da-4b28-b436-f6ca2de1222e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.761905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.781801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.782619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.782975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.783348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.784165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:25.784409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.785785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.813650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 300/602] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:25.819058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.843356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481a0ce-aa74-45df-b95d-5f756ed08387 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.880168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.881158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.881651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.882165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.883164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:25.883700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.885373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.899474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 303/603] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:25.906879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:25.928524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e02041-4e57-4b77-9373-6b10dec984b1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:25.965107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:25.965914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:25.967088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:25.967601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:25.974693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:25.976347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:25.984283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:25.992427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:25.993708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:25.994831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 301/604] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:26.000492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:26.021367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb9f9-adda-41aa-b55d-cc25c067596f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:26.046935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:26.057178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16a36b-833d-455d-9926-3436bea69ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:26.058225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a36b-833d-455d-9926-3436bea69ba0 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:26.058636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a36b-833d-455d-9926-3436bea69ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:26.072350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a36b-833d-455d-9926-3436bea69ba0 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/750b39980ed14876879b80fe6ca61482/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:26.076828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16a36b-833d-455d-9926-3436bea69ba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=750b39980ed14876879b80fe6ca61482, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:26.078490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16a36b-833d-455d-9926-3436bea69ba0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:26.111879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac479c-b8b2-4f34-a7c5-a62bc69920a8 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:26.148896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:26.149846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:26.150373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:26.150877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:26.151887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:26.152455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:26.154141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:26.167351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 302/605] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:26.174383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:26.213350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 304/606] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:25 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/750b39980ed14876879b80fe6ca61482/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:26.322144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5176e-4eea-48c2-adc9-88d6af26e5ab None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:26.331186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:26.369253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4d456-0940-4a49-90b6-1b743f9aacca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:26.370164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d456-0940-4a49-90b6-1b743f9aacca None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:26.370457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d456-0940-4a49-90b6-1b743f9aacca None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:26.370739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4d456-0940-4a49-90b6-1b743f9aacca None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/8996a1cff4474efeac1878197b5c07b2/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:26.392911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4d456-0940-4a49-90b6-1b743f9aacca None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=8996a1cff4474efeac1878197b5c07b2, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:26.394434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4d456-0940-4a49-90b6-1b743f9aacca None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:26.480481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 303/607] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:26 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/8996a1cff4474efeac1878197b5c07b2/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:31:26.590427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04d0a-de33-4b97-8a27-4d1acb94a764 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:26.590772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04d0a-de33-4b97-8a27-4d1acb94a764 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:26.590988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04d0a-de33-4b97-8a27-4d1acb94a764 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:26.593286 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 305/608] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:26.598652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:26.598947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:26.599227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:26.621627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:26.622907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:26.718569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 304/609] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:26.740792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04d0a-de33-4b97-8a27-4d1acb94a764 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:26.851613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04d0a-de33-4b97-8a27-4d1acb94a764 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:26.865819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:26.895124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a4c58-68fc-4ea5-ae86-6df474028445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:26.895945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a4c58-68fc-4ea5-ae86-6df474028445 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:26.896224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a4c58-68fc-4ea5-ae86-6df474028445 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:26.896491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a4c58-68fc-4ea5-ae86-6df474028445 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:26.909809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a4c58-68fc-4ea5-ae86-6df474028445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4a6a4c58-68fc-4ea5-ae86-6df474028445 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:26.917901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:26.918829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:26.920807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:26.921746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 306/610] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:26.933170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.080610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:27.108155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d16f-4540-46c5-bd10-c4ae071416d4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:27.158860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:27.159266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fcd8-db77-4b4a-a183-746851526f84 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.159542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.159650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fcd8-db77-4b4a-a183-746851526f84 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.159809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.159939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fcd8-db77-4b4a-a183-746851526f84 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.160117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.160859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:27.161168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:27.161459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 307/611] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:27.162524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:27.166639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.166928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.167210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.185596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 305/612] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:27.187289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.200543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:27.202285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:27.327965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 308/613] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 12:31:27.361357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30ae3-1caf-4bb1-b006-64e24e216df5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:27.377384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.431183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:27.432007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.432291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.432564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.453143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:27.454557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:27.470212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:27.486167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:27.488482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:27.489752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:27.489752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:27.489752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:27.489752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:27.494269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 306/614] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:27.498633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.565238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:27.574229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc007e1-2090-4718-8f96-164f9b9c38c4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:27.649260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:27.649987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.650264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.650531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.665699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120acb-9cc2-41d2-8ccb-18a5c3f944ba None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:27.673614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:27.702526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:27.703465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:27.704343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 309/615] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:27.712806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.718516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:27.719213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.719490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.719769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.720531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:27.720846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:27.722237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:27.750606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 307/616] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:27.755504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.830438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a561654-433e-487e-bcd0-e95ab63f3b47 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:27.870237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:27.871420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:27.871990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:27.873092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:27.874063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:27.874604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:27.876209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:27.877238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:27.887883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 310/617] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:27.893822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:27.945475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:27.967180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3502f-caca-476b-b828-7acf1087be76 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.011293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.014265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.014960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.016585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.032891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.034707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:28.063564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:28.064608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:28.065628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:28.073364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 308/618] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:28.075786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.103499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92cc0-bcd2-4d7a-b356-a65d53c3c993 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.145247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.146075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.146358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.146669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.159490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.161008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9f0ac65c-37fb-43e3-9077-fd0e88c6eec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:28.179101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:28.180091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:28.180978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:28.180978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:28.180978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:28.180978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:28.180978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 311/619] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:28.186653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d230-3c56-4689-b435-dd0cf2987e04 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.186946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d230-3c56-4689-b435-dd0cf2987e04 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.187232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d230-3c56-4689-b435-dd0cf2987e04 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.192774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 312/620] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:28.192774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d230-3c56-4689-b435-dd0cf2987e04 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.212276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49c5d5-350d-47db-82e3-b3cafc52edd7 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.235028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:28.259269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.260366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.260941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.261592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.263847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:28.264437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.266641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80436f7f-842c-4dff-923f-90333388d364 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.280374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:28.295151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 309/621] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:28.295151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.295151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.295151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.308786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d230-3c56-4689-b435-dd0cf2987e04 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.317074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:28.318351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:28.351198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.351862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.352237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.352468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.353188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:28.353495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.354862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.371517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 313/622] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:28.373047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.416496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 310/623] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:28.418844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.493433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2a18-a5ba-4f71-9be8-5c29fa0171a6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.538427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.539449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.539949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.540354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.542848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:28.549685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06161-9ece-4820-80b9-1cd7455f86bb None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.552544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:28.554924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.556685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:28.575013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:28.576126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:28.577072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:28.577072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:28.577072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:28.577072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:28.579342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 314/624] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:28.580381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.594402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.599689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.599689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.599689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.603162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.604649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:28.621389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:28.622558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:28.623685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:28.625708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 311/625] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:28.626713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.709689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0ae85-71cc-4904-a9a8-375e913e2c1b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.733780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61776b-45ee-4964-94bb-b820ee782b03 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.746038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822fb81-6dd9-4cdb-8a9c-7be224344c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.746763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822fb81-6dd9-4cdb-8a9c-7be224344c69 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.747042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822fb81-6dd9-4cdb-8a9c-7be224344c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.747458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822fb81-6dd9-4cdb-8a9c-7be224344c69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.759106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822fb81-6dd9-4cdb-8a9c-7be224344c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5822fb81-6dd9-4cdb-8a9c-7be224344c69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:28.767606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:28.768774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:28.770199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 315/626] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:28.770966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a63790-5f09-4fbc-afb1-8866a77eab64 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.770966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a63790-5f09-4fbc-afb1-8866a77eab64 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.771182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a63790-5f09-4fbc-afb1-8866a77eab64 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.776215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 316/627] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:28.776215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a63790-5f09-4fbc-afb1-8866a77eab64 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.778882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.779566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.779843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.780217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.781594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:28.781594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.782529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.794904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 312/628] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:28.795563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.824515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:28.833676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:28.890640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a63790-5f09-4fbc-afb1-8866a77eab64 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.901387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9790-a5e8-4fe5-8200-3de11c772cb4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:28.927049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.927723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.928030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.928341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.929132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:28.929435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.930883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.937213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:28.937949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.938302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.938642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.939387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:28.939712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:28.941101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e478cc-3784-40f5-a2ac-7f2391b855f8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:28.953965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 313/629] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:28.954156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 317/630] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:28.954156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:28.954826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:28.955117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:28.955573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:28.973245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:28.974444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:29.041079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 314/631] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:29.041834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.061283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.068886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d413-4801-4ad0-ae69-981a6e5d9854 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.069142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.099427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.100245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.100599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.100888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.108192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.109850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:29.124674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:29.129801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 318/632] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:29.130922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.147736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b2fa-9a6e-455b-a59b-6336f2667f48 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.181263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.182059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.182343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.182621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.193354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.194795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-3235ba8b-34fe-4cf0-9174-2bd4052fbd8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:29.212065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:29.213423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:29.214362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:29.214362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:29.214362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:29.214362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:29.214362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 315/633] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:29.214657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b636d-5bdb-462e-8d83-b3cf62d00e71 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.214734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b636d-5bdb-462e-8d83-b3cf62d00e71 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.215228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b636d-5bdb-462e-8d83-b3cf62d00e71 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.216517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 316/634] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:29.220695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b636d-5bdb-462e-8d83-b3cf62d00e71 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.228224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aedb9-8756-46ed-be36-42ede09e9d66 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.262732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.263501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.263785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.264097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.290764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.294568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.324444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b636d-5bdb-462e-8d83-b3cf62d00e71 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.331510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.333172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.359848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.360647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.360926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.361198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.371435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:29.379877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:29.380963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:29.381809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 317/635] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:29.382519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.436653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 319/636] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:29.437489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.485566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8977f69-4c71-4d4b-ac02-e8c2c5a6a99c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.496760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.511550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.519472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.520179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.520461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.520733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.521591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:29.521895 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.523316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567cdff-7d7c-435a-8622-ec7eaa395607 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.534998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 318/637] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:29.538279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b475f8-799e-457a-b594-4394e9afbaa3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.538393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.538393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.538393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.554599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:29.555816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:29.569268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.569947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.570227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.570501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.571224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:29.571526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.572927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.585306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 320/638] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:29.586104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.623592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 319/639] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:29.624458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.688824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b46ed4-7bb8-429a-807b-b085e98e333e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.710811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.721951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.722614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.722894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.723171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.723910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:29.724244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.724467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381749a-c280-4c3d-b82e-e68de820bd57 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.725604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.735146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 321/640] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:29.735146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.742030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:29.758768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.759561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.759846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.760149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.771325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.772818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:29.790313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:29.791395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:29.792372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:29.792372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:29.792372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:29.792372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:29.792372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 320/641] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:29.792651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.837347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2129ed-7083-4462-9c5d-e6003ed42571 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.869869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.870737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.871013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.871284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/137aecde49064a4abf74de30e9a85875/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.885364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=137aecde49064a4abf74de30e9a85875, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.886783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.891061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a59ba-7589-4c76-ad90-94efd4ac8c20 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:29.924756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:29.925541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:29.925825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:29.926101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:29.932891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:29.934320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:29.948973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:29.950650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 321/642] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:29.952096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.962472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 322/643] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:29 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/137aecde49064a4abf74de30e9a85875/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:29.963292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:29.987090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.005470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.072297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1176f7d-e066-4fd3-a564-5b87b4bc0630 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.079532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f660c11-6210-472c-9458-896de82a1d30 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.117181 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.117983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.118471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.118757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.120127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.121427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.122628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.122924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.132007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:30.135600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.137329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:30.140473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:30.141440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 322/644] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:30.142853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:30.156486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:30.157613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:30.158713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:30.158713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:30.158713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:30.158713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:30.160404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 323/645] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:30.161377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.241873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.253041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85b86e-2c4e-429f-bb57-9d2383bf047e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.253963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.266713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ef752-388a-4291-8442-c4b7b3e5e060 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.287101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.288041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.288322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.288599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.289395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:30.289635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.291475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.302616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.303430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.303717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.304024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.304891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:30.310252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.310377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 323/646] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:30.310377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.310565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.328947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 324/647] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:30.329913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.420125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9b45d-436c-47a5-99a4-bfac349c8851 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.433467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e73b02-6537-4e3e-8ab1-7a752a388d60 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.456914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.457589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.458064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.458344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.459096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:30.459401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.460800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.469486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 324/648] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:30.470292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.472613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.473277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.473562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.473975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.474726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:30.475039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.477479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.488224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.496027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 325/649] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:30.496027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.504722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.583107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d24bbc-a6cd-4950-83be-c87195780207 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.598496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36b2d-4012-4d03-988c-8d0c5819fdc2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.617238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.618366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.618712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.619051 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.627057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.628616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.634054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.634771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.635138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.635481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:30.643871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:30.645017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:30.646159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:30.651401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 325/650] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:30.651401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.719004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.720579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.724311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.728700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.754747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10374c6a-6707-4168-ace7-8f5ac0d21185 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.793026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.794633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.794923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.795366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.805994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.807559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.820173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 326/651] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:30.821129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:30.828508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:30.829593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:30.830766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:30.830766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:30.830766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:30.830766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:30.834220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 326/652] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:30.835305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:30.928805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54434b5b-e889-48cf-9a02-44617acb6a60 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.936901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.941610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a786c-628a-4f14-9647-a11dd0e95bf5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:30.966250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:30.967553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.968367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.968694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.968920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.976137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.977337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:30.977563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.987536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:30.987536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:30.987536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:30.987536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:30.987536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:30.987536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:30.992522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:30.993935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 327/653] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:31.001471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.002262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 327/654] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:31.002262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.111085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec72a9-bece-40dd-981d-f31a8d70c1a8 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.118574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f9ae-81f5-47a0-9860-5c14dba30aaa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.146980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.147638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.147940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.148222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.148935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:31.149524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.150610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.163458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 328/655] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:31.164096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.165282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.166148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.166497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.166836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.181495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.183015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:31.201016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:31.201917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:31.202816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:31.202816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:31.202816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:31.202816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:31.206823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 328/656] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:31.207655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.215173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:31.234502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:31.271009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79650aa4-964f-404f-818d-ee9694158f7d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.310802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1c28b-8e55-408d-8eb2-b128620244cc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.311199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.311870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.312298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.312576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.313558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:31.313870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.315290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.334311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 329/657] 10.222.0.45 () {56 vars in 1137 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:31.335021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.348776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.349423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.349704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.349978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.350786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=62eba0e2bd914eeb949bb434f8a6cd9c) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:31.351095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.352552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.359239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 329/658] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/role_assignments?user.id=62eba0e2bd914eeb949bb434f8a6cd9c&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:31.359952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.464010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198d83-0b7f-40f7-bf94-8a2f079c1a7d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.466074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:31.480683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:31.509799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.510543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.510745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32634e0f-51d3-48ae-8ba2-94899df21f35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.510873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.511086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.519884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.521511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:31.539034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:31.541415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 330/659] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:31.542491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.561987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.562656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.562943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.563209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.563964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:31.564278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.565649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.579140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 330/660] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:31.580013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.679485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19002947-73d3-4df5-bf06-21e4a8e26f90 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.706063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d04f4e-f30f-40f6-9e70-b0e5a689abb5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.727323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.728114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.728468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.728908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.753041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.754600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.755235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.755798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.757107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:31.758021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.760246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.763688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:31.780703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:31.786000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 331/661] 10.222.0.45 () {56 vars in 1139 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:31.790900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.811994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.813579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.899745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658aab8-5305-40d8-880a-3a3f8f5770aa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:31.937219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:31.938719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:31.939144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:31.939671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:31.944942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 331/662] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:31.945879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:31.954458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:31.955945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:31.975762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:31.976931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:31.978216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:31.980151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 332/663] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:31.981100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.028084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.046278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.069317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a5da1-0fb0-4f58-a5d6-8de46c72401a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.089634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e32a4-8592-4531-8794-241814f6c862 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.103858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.104638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.105018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.105385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.127823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.128776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.129061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.129292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.141695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.143152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1b60fa88-f653-44dc-92cd-54177dff0b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:32.160330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:32.161336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:32.162257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:32.162257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:32.162257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:32.162257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:32.162257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 333/664] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:32.163247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b4da-a6a9-4189-a144-add4e7123d18 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.163532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b4da-a6a9-4189-a144-add4e7123d18 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.163805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b4da-a6a9-4189-a144-add4e7123d18 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.165206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 334/665] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:32.165949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4b4da-a6a9-4189-a144-add4e7123d18 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.185684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.187290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.251242 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.274754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4b4da-a6a9-4189-a144-add4e7123d18 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.290444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.297274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 332/666] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:32.297274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.316138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.316874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.317227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.317579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.318435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:32.318825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.320463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62236-75b9-4d26-a09d-fd1eced993f4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.338153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 335/667] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:32.338153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.338153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.338153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.357143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:32.358879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:32.401581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111622e-72ab-40dc-98cd-85944bc75443 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.436244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 336/668] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:32.436970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.451240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02797057-a3e3-4806-8668-016db0393991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.455133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02797057-a3e3-4806-8668-016db0393991 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.456278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02797057-a3e3-4806-8668-016db0393991 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.457074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02797057-a3e3-4806-8668-016db0393991 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.458304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02797057-a3e3-4806-8668-016db0393991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:32.458735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02797057-a3e3-4806-8668-016db0393991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.460557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02797057-a3e3-4806-8668-016db0393991 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.477015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 333/669] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:32.479963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02797057-a3e3-4806-8668-016db0393991 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.509557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.547527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7bd48-2b5e-49f0-a214-bf87f2086185 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.549176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.582108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.582898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.583306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.583593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.587494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02797057-a3e3-4806-8668-016db0393991 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.594861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.596349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:32.614818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:32.615970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:32.616866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:32.616866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:32.616866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:32.616866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:32.616866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 337/670] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:32.617503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.630371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.631145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.631423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.631692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.632544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=06abb3c5b9f842fca49b9a44e7feb99d) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:32.632851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.634277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.641442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 334/671] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/role_assignments?user.id=06abb3c5b9f842fca49b9a44e7feb99d&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:32.642285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.764589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.768085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d5cdb-0320-45f1-b0c0-00befa4b0427 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.785427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cebe-b3b3-4618-912d-23d63ac72eaa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.823516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.824628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.825139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.825553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.828719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:32.829519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:32.829806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:32.830080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:32.837052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:32.837483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:32.838511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:32.845479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:32.846562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 338/672] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:32.847427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:32.858531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:32.859655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:32.860834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:32.862811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 335/673] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:32.863733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:32.870219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:32.963360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41284165-f428-440f-9723-eaf7cb414d4a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.994050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96c8df-0c9f-44d0-beb4-2dc551e827e5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:32.999963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.000714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.001082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.001420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.002212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.002585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.004047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.017038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 339/674] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.018007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.038170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.038990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.039360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.039742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.040646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.041026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.042534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.052041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 336/675] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.057450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.088404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.125503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.159007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99087d7-bfba-411d-a709-e0ab8c3663e1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.169311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3eb1e4-e5d8-4a9b-b76e-30e98df398fb None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.196753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.197279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.197562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.197839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.198631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.198943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.201195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.214337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.214691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 340/676] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.215295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.215641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.215954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.216625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.231097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.232601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:33.254214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:33.255155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:33.256071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:33.260004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 337/677] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:33.260837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.336430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0a9f3-1381-47c2-8ef9-083ec180dc86 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.344590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.373026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.373818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.374103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.374381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.376217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e401a-2943-48d6-b012-24b24e442cde None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.376331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.385742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.387198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:33.409662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:33.416489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:33.417380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:33.417380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:33.417380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:33.417380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:33.417380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 341/678] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:33.417380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.421022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.421689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.421968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.422243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.423080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=750b39980ed14876879b80fe6ca61482) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.423392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.424878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.431724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 338/679] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/role_assignments?user.id=750b39980ed14876879b80fe6ca61482&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.433220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.536007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c63a5-7921-4a3a-813f-57492a932b52 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.599519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.600301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.600677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.601023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.601885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.602260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.603769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e5eb2-5ba1-41ed-8e9f-841546906868 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.611168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e127e3-fceb-4612-a859-4eef79dc4f2c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.620843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 342/680] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.622930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf2fb-3a9f-4e2d-a51a-fcfe5420c48f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.623286 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf2fb-3a9f-4e2d-a51a-fcfe5420c48f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.623631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bf2fb-3a9f-4e2d-a51a-fcfe5420c48f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.625608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 343/681] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:33.626417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bf2fb-3a9f-4e2d-a51a-fcfe5420c48f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.654065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.661581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.662251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.662536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.662811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.663535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.665772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.665772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6b9e1-90ba-4325-b22a-e0db92de6a9c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.678247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 339/682] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.679507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.680535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.680756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.695098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.706161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:33.708105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:33.763127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bf2fb-3a9f-4e2d-a51a-fcfe5420c48f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.800941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 340/683] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:33.808003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.915373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835679df-62f8-47fb-b747-c6ffecf262e9 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:33.941321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:33.950305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.951980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.951980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.951980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.952743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=8996a1cff4474efeac1878197b5c07b2) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:33.953070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.954497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:33.955167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:33.956188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:33.956725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:33.957197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:33.967957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 344/684] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/role_assignments?user.id=8996a1cff4474efeac1878197b5c07b2&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:33.967957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:33.968950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:33.970902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:34.002055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:34.003169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:34.004331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:34.011053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 341/685] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:34.012119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:34.176235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e341a-a350-48c3-a676-dadfd1318988 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:34.187868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:34.199781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e9954-a419-40eb-8257-d62553df2a6c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:34.219430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:34.220490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:34.222124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:34.222508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:34.236265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:34.244643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:34.245655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:34.246498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:34.247179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 345/686] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:34.252795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:34.253484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:34.254368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:34.255018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:34.255297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:34.256339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:34.256464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:34.258452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:34.278128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 342/687] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Jul 25 12:31:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:34.285777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:34.353133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:34.398189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e4b03-0543-4a26-8a56-872a4f114193 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:34.437300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:34.438190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:34.438616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:34.439139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:34.440148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:34.440610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:34.442119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:34.454837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 346/688] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:34.459845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:34.468837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10111b6b-2cbd-4278-a060-82477c9427fa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:34.526083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:34.538877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:34.539539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:34.539817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:34.540142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:34.661472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b99043-97fd-48cb-8114-bb3161a37bf2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:34.669658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:34.671224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:34.731122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:34.732282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:34.732401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:34.732625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:34.732905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:34.757959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:34.759441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:34.791834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:34.792816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:34.793928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:34.793928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:34.793928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:34.793928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:34.797488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 347/689] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:34.800869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:34.831400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 343/690] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:34.836669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:34.982177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:34.995127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25c2eb-2816-4d6a-b4cd-10ac2266f08d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.017210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc94d-d55d-4c04-9d20-ae136b80c86d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.033132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.033925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.034205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.034477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.044366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.048127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.049653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.057824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.058568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.058928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.061022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.061765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:35.062073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.063418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115770d-55a1-487f-a79e-27985ebc9e4c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:35.073054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:35.073964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:35.074961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:35.074961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:35.074961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:35.074961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:35.076104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 348/691] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:35.076904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f355559-d529-4d57-9062-f635da4ccca9 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.077190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f355559-d529-4d57-9062-f635da4ccca9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.077716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f355559-d529-4d57-9062-f635da4ccca9 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.083601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 344/692] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:35.083715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 349/693] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:35.083794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.084391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f355559-d529-4d57-9062-f635da4ccca9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.192091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64084371-a45e-4c50-8d12-e96b8210413c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.203899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f355559-d529-4d57-9062-f635da4ccca9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.230590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.232372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.232875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.233510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.241849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.242075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.242733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.243265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.243536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.244353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:35.244655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.245072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.246116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3510d-1e22-4081-8097-aae66c324897 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.259130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 350/694] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:35.260510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.260795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.261071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:35.262769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:35.263973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:35.264949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:35.267527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 345/695] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:35.268621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.270402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.282804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:35.284506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:35.339312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.357192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 351/696] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:35.358663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.400641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ecca6-911e-43e4-8c49-3a7928833880 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.443651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.445101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.445621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.446108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.455256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.457147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:35.472710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:35.473654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:35.474558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:35.474995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04864cce-3e29-441e-a5c2-7058a393ef51 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.477332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 346/697] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:35.478409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.512982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.514190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.514677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.515168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.516227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:35.516777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.518418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.520421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.538798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 352/698] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:35.540034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.602675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bce82-556d-46e3-a695-397107c1489c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.616533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.639151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.639980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.640257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.640526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.649860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca877a-078d-4b7d-b486-8d6605f85d38 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.651107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.652598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:35.672107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:35.673077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:35.674641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:35.674641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:35.674641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:35.674641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:35.674641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 347/699] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:35.674641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.701782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.702595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.702982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.703361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.704292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:35.704709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.706260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.721074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 353/700] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:35.722026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.777602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.792868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbe560-08e2-4ddb-a937-6c600cd08df3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.832539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.833552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.834022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a5913-bb42-499e-b105-22feb7dd6705 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:35.834349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.834855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.869136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:35.869798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.870082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.870210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:35.870446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.871157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:35.871495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.873800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde4d66-321e-4daa-adf9-7cb5eb18395d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:35.891285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 354/701] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:35.892711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68d08-8d76-4e5b-9e3b-040b35c19175 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:35.893002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68d08-8d76-4e5b-9e3b-040b35c19175 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:35.893287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68d08-8d76-4e5b-9e3b-040b35c19175 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:35.894712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 355/702] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:35.895261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68d08-8d76-4e5b-9e3b-040b35c19175 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:35.909133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:35.910622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.004770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68d08-8d76-4e5b-9e3b-040b35c19175 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.019069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.025164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 348/703] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:36.027800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.041030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.041683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.041966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.042238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.043066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=137aecde49064a4abf74de30e9a85875) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:36.043377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.045413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abfb59-541f-442b-bfb1-06d22ee43416 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.051863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 356/704] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:35 2022] GET /identity/v3/role_assignments?user.id=137aecde49064a4abf74de30e9a85875&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:36.053098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.053388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.053669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.074094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:36.075666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:36.119519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.156514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 357/705] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:36.157401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.173883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8968b43-08e8-4a39-8308-76baa3c8f67f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.224821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.225315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.225602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.225880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.226600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.228816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.282052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae838b4a-c3b2-4aed-a50d-67ecf3a79f80 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.290814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 349/706] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:31:36 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:36.291417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.291836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.351330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.352901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.353829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.354408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.373239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.375323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b6ba3821-8dee-4507-89bb-621d7576ec05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:36.401310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:36.402304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:36.403475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:36.403475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:36.403475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:36.403475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:36.403475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 358/707] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:36.405044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9389-8ca3-4d14-bc5b-bd534855aade None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.405333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9389-8ca3-4d14-bc5b-bd534855aade None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.405611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9389-8ca3-4d14-bc5b-bd534855aade None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.410481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 359/708] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:36.410919 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9389-8ca3-4d14-bc5b-bd534855aade None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.450990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf44eb-c370-4cd0-a5fb-1d299b8e59aa None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.473521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.491430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.492280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.492561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.493225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.493741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.495112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-bff023f6-5378-4814-bc8b-f5a4c3492f7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:36.511100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:36.512593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:36.513495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:36.515961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 350/709] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:36.518076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.518361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.518637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.530049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9389-8ca3-4d14-bc5b-bd534855aade None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.539824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:36.540497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:36.573517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.574177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.574460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.574775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.575500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:36.575826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.577215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.590163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 360/710] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:36.591123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.615436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.624317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 351/711] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:36.625275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.722135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0e878-1207-41cf-84a0-2bc43af18128 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.759054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc593575-cf1b-4467-bc77-9327e74c81f6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.763609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.764308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.764586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.764855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.765562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:36.765861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.767701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.774224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 361/712] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:36.774759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.775039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.799590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.800463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.800746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.801027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.807993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.810207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:36.827987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:36.829003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:36.829915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 352/713] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:36.830413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:36.882522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:36.915954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828623-47f9-4fbf-8043-1670691e0ca5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.946605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0588a84-3e6e-48e0-b2d5-7be4bcf72ff2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:36.963962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.965086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.965890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.966412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.967583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.969145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.984967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:36.985772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:36.986158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:36.986536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:36.987352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:36.987816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:36.988044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:36.989193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:36.990217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:36.992276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:36.993331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 362/714] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:36.994327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:37.006288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 353/715] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:37.007237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:37.055264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:37.168922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830985f3-6c49-4b63-8bc2-442134258c32 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:37.172657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4be7b-6de9-4678-bb51-cdb9f57cfd50 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:37.229109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:37.229784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:37.230071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:37.230348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:37.230593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:37.231109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] RBAC: Adding query filter params (name=network) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:37.231423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:37.231568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:37.231744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:37.232016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:37.232811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:37.232982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:37.233136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:37.234529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:37.238540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 354/716] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:31:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:37.245740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:37.251059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 363/717] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:37.256548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:37.266127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:37.365222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569956d5-6de5-43c8-a525-e0bf0785910c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:37.395001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b27cb-0d2a-4c3b-924c-5b9538c34929 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:37.396730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:37.407865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:37.412077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:37.412077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:37.412077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:37.412077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=62eba0e2bd914eeb949bb434f8a6cd9c) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:37.412077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:37.412077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6180f-742e-4a99-b45f-5fdc9bd4b88b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:37.423286 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 364/718] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:37 2022] GET /identity/v3/role_assignments?user.id=62eba0e2bd914eeb949bb434f8a6cd9c&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:37.445501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:37.446174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:37.446504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:37.446817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:37.447567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] RBAC: Adding query filter params (type=network) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:37.447881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:37.449321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd2a23-1cfb-4729-a6ce-6beac5b4001a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:37.456524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 355/719] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:31:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:38.697119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a660-d7fc-4c9a-b9cc-6814f6212f7b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:38.697989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a660-d7fc-4c9a-b9cc-6814f6212f7b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:38.698409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017a660-d7fc-4c9a-b9cc-6814f6212f7b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:38.700614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 365/720] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:38.706779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:38.707618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:38.708121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:38.732865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:38.734259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:38.753336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e3755-aee8-456b-9848-0112637007cc None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:38.753624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e3755-aee8-456b-9848-0112637007cc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:38.753907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e3755-aee8-456b-9848-0112637007cc None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:38.755535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 366/721] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:38.760535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:38.760796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:38.761076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:38.795626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:38.795626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:38.837014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 356/722] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:38.881898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:38.885257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:38.900511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 367/723] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:38.933922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.053418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:39.065905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac6395-92d0-4f2d-9e9f-71d23345a4bd None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.086450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59600f4-c2f6-4e99-808c-6304782b3251 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.127182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.128313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.128926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.129508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.141667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:39.149903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:39.150842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:39.151689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:39.155059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 368/724] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:39.161557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.189197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.190028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.190314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.190592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.240402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:39.247402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:39.248350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:39.249195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:39.249867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:39.256636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 357/725] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:39.263057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.316020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25bbd-bf1b-417c-98b0-1e970affabe2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.363118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.363792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.364107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.364382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.365137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:39.365441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:39.366818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:39.382841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 369/726] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:39.388730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.477005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c360f-2e88-4ec1-8876-26c57faccdac None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.519412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.520483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.521084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.521665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.522638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:39.523147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:39.525014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:39.532082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0f11-338c-4e58-8aed-ee65647822e5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.540306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 358/727] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:39.548985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.577341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:39.588144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:39.588866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.589666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.589942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.598293 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.612017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:39.613494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a484ba21-c219-4be9-a729-aa92fedda6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:39.634799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:39.640518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 370/728] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dac1c-726c-477e-a07e-c3b81eaa579c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dac1c-726c-477e-a07e-c3b81eaa579c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.641598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dac1c-726c-477e-a07e-c3b81eaa579c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.643994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 371/729] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:39.645494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dac1c-726c-477e-a07e-c3b81eaa579c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.707881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6a04-e88b-4e56-b608-d900642904ca None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.750922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.751900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.752226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.752504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.765015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:39.766485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:39.778312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dac1c-726c-477e-a07e-c3b81eaa579c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-8bdbf383-3401-4466-9ecd-1a1eae865de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:39.786771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:39.787662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:39.788921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:39.788921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:39.788921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:39.788921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:39.789478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 359/730] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:39.790764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.791058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.791337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.811023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:39.812283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:39.818740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:39.819497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.819786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.820317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.820792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:39.821096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:39.822502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4644e8-5d84-458a-95f0-f930bdc603b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:39.839763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 372/731] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:39.839763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0f40-7259-4fae-80d3-e9cb23f0f693 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:39.839763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0f40-7259-4fae-80d3-e9cb23f0f693 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:39.839763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0f40-7259-4fae-80d3-e9cb23f0f693 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:39.839763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 373/732] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:39.839763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0f40-7259-4fae-80d3-e9cb23f0f693 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.883976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:39.886267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:39.891024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 360/733] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:39.892039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:39.966500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0f40-7259-4fae-80d3-e9cb23f0f693 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:39.995855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2643324-3984-471d-bec5-3ce46483a23e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.001077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.001734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.002012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.002283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.002995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:40.003295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.004704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25661e-7e05-429e-8e81-32d858c69c64 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.020346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 374/734] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:40.020346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.020346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.020346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.033049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.033864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.034196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.034467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.037110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:40.038292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:40.042390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.044542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:40.060605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:40.061757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 361/735] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:31:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:40.062795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.116608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 375/736] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:40.117583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.161676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.165254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.206213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9eeec-4b9f-41b6-9d8c-04bd50720bd6 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.235885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a301d0e-cb62-4bce-8ccc-2cd5c6620db7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.239054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0615bb-2922-4c05-ab1e-8b620261938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.239710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0615bb-2922-4c05-ab1e-8b620261938f None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.240015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0615bb-2922-4c05-ab1e-8b620261938f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.240285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0615bb-2922-4c05-ab1e-8b620261938f None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.241002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0615bb-2922-4c05-ab1e-8b620261938f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.242359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0615bb-2922-4c05-ab1e-8b620261938f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.270420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.271208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.271491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.271790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.278937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.280486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:40.295339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:40.298071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 376/737] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:40.299130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.327960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 362/738] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:31:40 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:40.327960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd686-43e4-4fda-8a6e-514bf72765d6 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.327960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd686-43e4-4fda-8a6e-514bf72765d6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.327960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd686-43e4-4fda-8a6e-514bf72765d6 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.327960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 363/739] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:40.327960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd686-43e4-4fda-8a6e-514bf72765d6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.394886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.413972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed463e7-18a7-4c62-8de3-243ff592959f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.450189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd686-43e4-4fda-8a6e-514bf72765d6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.455775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.456758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.457194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.457609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.458729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:40.459209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.460970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.470120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.481785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 377/740] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:40.482734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.494364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c95610-eeef-4225-ad92-5b90820f1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.497310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95610-eeef-4225-ad92-5b90820f1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.497310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95610-eeef-4225-ad92-5b90820f1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.497310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95610-eeef-4225-ad92-5b90820f1ec1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.507372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c95610-eeef-4225-ad92-5b90820f1ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d3c95610-eeef-4225-ad92-5b90820f1ec1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:40.516058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:40.517197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:40.518223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 364/741] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:40.519387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.519682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.519990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.540504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:40.541880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:40.596740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7f1a7-913d-4cf7-bfc0-1884e6fd5c4e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.622295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 365/742] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 12:31:40.622295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.642775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.643444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.643725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.644027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.644858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:40.645216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.646586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.661942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.665766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 378/743] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:40.669932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.737723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fedec-6854-4da3-a928-fb8e327d4c8b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.745750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.774917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.775569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.775849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.776192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.779031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514799a-c92c-4b99-b67a-60a81d30b228 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.817112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.818230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.818562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.818840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.819994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:40.820308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.822004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.835124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 379/744] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:40.835124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.853908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.855346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:40.895418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.938104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae61ed-bad6-406f-a49d-a452c91a159f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:40.966460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 366/745] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 12:31:40.966460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:40.971354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:40.981300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:40.982168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:40.982443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:40.983331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:40.983497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:40.984885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.047953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 380/746] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:31:40 2022] POST /identity/v3/services => generated 240 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:41.047953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.084276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561417d6-0927-4b35-8a77-bd791191d578 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.143100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e149-905f-473f-9868-a452fd65805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.144287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e149-905f-473f-9868-a452fd65805e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.144566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e149-905f-473f-9868-a452fd65805e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.144837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765e149-905f-473f-9868-a452fd65805e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.171829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12344bb-0c20-48ef-916c-176f67f34431 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.204321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:41.220268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.221071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.221349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.221672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.234270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.235722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.236013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e149-905f-473f-9868-a452fd65805e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.237782 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765e149-905f-473f-9868-a452fd65805e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.241730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:41.256052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:41.256996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:41.258301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:41.258301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:41.258301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:41.258301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:41.258301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 381/747] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:41.258301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.371943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 367/748] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:31:41.371943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e149-905f-473f-9868-a452fd65805e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.385935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9c421-2b8e-49f3-a97a-706b6b4842fa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.423897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.425005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.425005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.425204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.436747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.438208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:41.457267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:41.458221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:41.459675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:41.459675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:41.459675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:41.459675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:41.459675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 382/749] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:41.459675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.493322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:41.509311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765e149-905f-473f-9868-a452fd65805e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.511545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:41.549572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.550661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.551235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.551702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.552695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:41.553205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.554998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.568402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 368/750] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:41.569635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.574926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06feaaad-3db9-4a6c-9c7d-7f42fc9bedfa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.613022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.614175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.614657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.615155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.627467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.629403 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:41.648351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:41.649321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:41.650215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:41.650215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:41.650215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:41.650215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:41.656019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 383/751] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:41.657093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.691159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc73c9-bc92-455d-bac3-28bfd06f5633 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.731346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.732435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.732915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.733382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.734297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:41.734806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.736432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.749369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 369/752] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:41.750948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.760880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:41.776910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:41.790508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e1a50-aed3-425e-9521-562496561f40 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.839180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.840599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.841050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.841333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.851284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.853114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.864408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e6fe-084b-4c2f-95ea-e757eef97406 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:41.873986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:41.874933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 384/753] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:41.876497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.906305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:41.907331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:41.907861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:41.908472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:41.909409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:41.909912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:41.911695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:41.935289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 370/754] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:41.935289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:41.991105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79163280-14c7-4172-9de0-0ad37da48010 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.030883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.031676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.032081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.032348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.033494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:42.040178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.041840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.044118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:42.053784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c40452-69bb-4446-be8e-c3257828b5b3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:42.057488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:42.058364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:42.059879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:42.062545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 385/755] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:42.063605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.092641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.093399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.093752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.094026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.095363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:42.095815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.097380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.164876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 371/756] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:31:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:42.165901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.225063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa653e-f1f9-4ba1-9040-167460d9291e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.266485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.267671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.268266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.268750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.271080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa94693-fc63-4683-bea4-ca2f67474d7d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.276600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.278398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:42.295140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:42.296097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:42.296996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:42.299550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 386/757] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:42.300588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.313979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.315556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.316096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.316598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.318040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:42.318979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.321272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.338412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:42.344524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 372/758] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:42.345483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.377757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:42.425949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb338a2-4303-4963-bf1a-a6d3e2ac441c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.451508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051db98-2c40-4f61-a30e-3bf61727fd25 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.462709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.463538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.463822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.464123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.474843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.476312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.486206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.486861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.487144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.487417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.488226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:42.488536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.489963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77318914-5677-47e3-a6fe-709a1fbed5ac None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:42.493993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:42.494880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:42.500958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:42.500958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:42.500958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:42.500958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:42.500958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 387/759] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:42.500958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.512591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 373/760] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:42.512591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2095-377d-4198-8b42-0d938e8d7f73 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.512591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2095-377d-4198-8b42-0d938e8d7f73 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.512591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d2095-377d-4198-8b42-0d938e8d7f73 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.512591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 374/761] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:42.512591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2095-377d-4198-8b42-0d938e8d7f73 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.620174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866727a8-4bd2-4211-b59b-4e1d8a84fe30 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.633181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:42.660349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.661010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.661290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.661563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.662413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:42.662724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.664194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.680396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 388/762] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/role_assignments?user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:42.681215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:42.713144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:42.761340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d2095-377d-4198-8b42-0d938e8d7f73 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.840813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.842520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.845603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.846170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.847132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:42.848688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.850303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d7f0f-732c-40cd-a676-760338fe77b5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.885403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 375/763] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:42.888142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.888788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.889392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.910857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:42.912984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:42.919601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1460098-5912-412c-8b3c-89119f09e5a3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:42.961465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:42.962137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:42.962419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:42.962739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:42.963572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=137aecde49064a4abf74de30e9a85875) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:42.963885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:42.970673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:42.989713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 389/764] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/role_assignments?user.id=137aecde49064a4abf74de30e9a85875&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:42.991968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.009731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 376/765] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:43.058215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.097122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:43.181976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:43.237581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd9e7-b588-4d78-807e-8c0c1017b834 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.241158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2becd-a082-4363-bc0c-e5ddc5a5110f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.275799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.276980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.277679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.278091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.283280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.284380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.284866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.285579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.286068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.286619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.287520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.288379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-937e3db9-df76-4261-b522-1a41898a0e56 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:43.302855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:43.303964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:43.304830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ded96a53-34e3-42d5-9ad0-b62e4c9f5106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:43.305636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:43.306452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 390/766] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f19c2-2250-4734-bc46-1d738454b868 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.307344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f19c2-2250-4734-bc46-1d738454b868 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.307968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f19c2-2250-4734-bc46-1d738454b868 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.307968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 391/767] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:43.310233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f19c2-2250-4734-bc46-1d738454b868 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.311042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 377/768] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:43.313190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.313646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.314084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.337224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:43.339064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:43.423868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 378/769] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:43.425660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.460195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:43.465291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f19c2-2250-4734-bc46-1d738454b868 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.489790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:43.504951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.506289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.506774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.507445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.508638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:43.513571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.513571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.529657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 392/770] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:43.532034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.552120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed02f23-4373-422a-9bc4-125892133ab8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.591234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.592164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.592548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.593045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.593850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:43.594212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.595756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.606381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 379/771] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:43.607719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.649465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6499fb-8960-485c-8560-0a2f783c4795 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.692498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.693401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.693686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.693969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.694650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.696139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:43.709401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:43.710432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:43.711274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:43.716293 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 393/772] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:43.717178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.717603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23226772-944d-4f47-bbc1-f94b2c710774 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.726927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:43.752313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:43.752919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.753880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.754230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.754620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/62eba0e2bd914eeb949bb434f8a6cd9c/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.757172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=62eba0e2bd914eeb949bb434f8a6cd9c, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.758664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.823282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec2067-923f-4c45-8d02-eaf99322006b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:43.856309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 380/773] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:43 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/62eba0e2bd914eeb949bb434f8a6cd9c/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:43.857406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:43.870710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:43.871821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:43.872331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:43.872819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:43.873698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:43.874201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:43.875908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:43.888898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 394/774] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:43.896087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:44.057359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdab819-1bfb-4543-b7a4-4e191746d908 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:44.089279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:44.096719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:44.097399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.097700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.097952 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.098657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] RBAC: Adding query filter params (name=network) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:44.098962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:44.100369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:44.105997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 381/775] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:44.111287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:44.112345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e788e-d31f-4e24-a9bd-4be58f4a8433 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:44.151234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:44.153662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:44.154578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.155069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.155558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.156617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] RBAC: Adding query filter params (interface=public, service_id=a27b31830de94885b4aca12e1a942d66, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:44.157145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:44.158821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:44.175531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 395/776] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:31:43 2022] GET /identity/v3/endpoints?service_id=a27b31830de94885b4aca12e1a942d66&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:44.189259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:44.240079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad36aee-9067-4adb-aedd-70c21774db76 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:44.278342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:44.279026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.279303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.279572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.280312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] RBAC: Adding query filter params (type=network) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:44.280617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:44.281990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:44.293042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 382/777] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:31:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:44.300954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:44.338325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c333a4-4848-497f-a362-40a05c40aa74 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:44.376907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:44.377756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.378133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.378508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.379295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:44.380799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:44.386611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 396/778] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:31:44 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:44.457399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:44.463667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6733d58-64a3-4255-b9bc-4fb421ff9603 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:44.524292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:44.525392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.525884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.526366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.528134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] RBAC: Adding query filter params (interface=public, service_id=62ebd6ebb01a46cf9d8f424f8dcd10e3, region_id=RegionOne) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:44.528826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:44.530979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bbdcb-9780-4957-8369-74d34dad8c04 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:44.547396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 383/779] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:31:44 2022] GET /identity/v3/endpoints?service_id=62ebd6ebb01a46cf9d8f424f8dcd10e3&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:44.553131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:44.571556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:44.667199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3479a-c47d-4872-b22a-c5f0aaaa6ced None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:44.705984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a86ed-8b14-48f8-965a-991b1c3faa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:44.706648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a86ed-8b14-48f8-965a-991b1c3faa58 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.706924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a86ed-8b14-48f8-965a-991b1c3faa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.707194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a86ed-8b14-48f8-965a-991b1c3faa58 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.707870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a86ed-8b14-48f8-965a-991b1c3faa58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:44.709282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a86ed-8b14-48f8-965a-991b1c3faa58 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:44.715771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 397/780] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:31:44 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:44.929614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750603-3a68-4cd7-b60b-9bdc9e3b4681 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.930113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750603-3a68-4cd7-b60b-9bdc9e3b4681 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.930113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750603-3a68-4cd7-b60b-9bdc9e3b4681 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.931666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 384/781] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:44.937570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:44.937867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:44.938146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:44.960983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:44.962597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:45.041332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 398/782] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:45.063964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750603-3a68-4cd7-b60b-9bdc9e3b4681 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:45.180604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750603-3a68-4cd7-b60b-9bdc9e3b4681 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:45.232485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:45.233288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:45.233566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:45.233837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:45.253832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:45.261712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:45.262688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:45.263535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 385/783] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:45.271192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:45.286041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:45.435121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f094c5-7535-4b48-ac8e-ce3b84ca70f2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:45.484338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:45.485010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:45.485295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:45.485573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:45.486328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:45.486636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:45.488032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632bf64-3124-4355-aeba-40981bff1395 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:45.500299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 399/784] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:45.505754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:45.564306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:45.576330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2347d4-6739-4014-96c9-3ea003476233 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:45.586365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2347d4-6739-4014-96c9-3ea003476233 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:45.586365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2347d4-6739-4014-96c9-3ea003476233 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:45.586365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 400/785] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:45.586365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:45.586365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:45.586365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:45.611803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:45.613027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:45.716166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490155a-74e3-47c3-8ccb-222bd1cc7df9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:45.745339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:45.752292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 401/786] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:31:45.777909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:45.778708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:45.778991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:45.779265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:45.789780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:45.791248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:45.810446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:45.811389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:45.812313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:45.812313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:45.812313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:45.812313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:45.812567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:45.815859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 386/787] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:45.821487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:45.966284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545245ca-0908-471c-b4cc-080e8fbbe152 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:45.977649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.025896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1e9c0-7cb1-4f1f-95e3-cc6eccbd2ff3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.027786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.028802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.029088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.029364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.041029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:46.052299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:46.053249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:46.054108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 402/788] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:46.059418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.112535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.113212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.113494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.113764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.114489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:46.114790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.116215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.129934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.140172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 387/789] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:46.146532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.177874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccd1f-2406-4636-9ca1-1e2924aeec18 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.216275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.217447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.217815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.218222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.219211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:46.219525 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.220933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.231195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 403/790] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:46.241422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.314433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e8c3e-2f96-49ef-9cd3-7f1a038ed870 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.354825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.360484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.361314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.361590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.361860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.372140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.373631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.385868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddee25-de83-4171-8f0e-f100e64aa967 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0c979c89-a736-4c2e-b0a8-84f07b5eca97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:46.388701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:46.389629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:46.390582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:46.394765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 388/791] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:46.396188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea55fe-57f3-4749-9ebc-5e056ca4da45 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.396482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea55fe-57f3-4749-9ebc-5e056ca4da45 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.396761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea55fe-57f3-4749-9ebc-5e056ca4da45 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.398305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 389/792] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:46.399008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea55fe-57f3-4749-9ebc-5e056ca4da45 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.414138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.430522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.431584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.431866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.432418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.455796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.457284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fd344190-9d55-441d-8ce5-473f9b7bd65f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:46.477710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:46.478692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:46.479619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:46.479619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:46.479619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:46.479619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:46.479619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 404/793] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:46.481082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.481455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.481622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.500939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:46.502185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:46.541008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea55fe-57f3-4749-9ebc-5e056ca4da45 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.573427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 405/794] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:46.574496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.587568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.588654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.589384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.590422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.599743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:46.599743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.599743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.626047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 390/795] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:46.626916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.682733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.717870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eefd8-5fb4-4f54-bc82-caea2afb594b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.720719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.735345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdb04d-1b4d-4b14-8306-22230df5ccf0 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.762597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.763540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.763945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.764350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.765292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:46.765710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.767273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.773559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.774602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.775022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.775434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.786483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 406/796] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:46.786483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.792426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:46.801271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:46.802200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:46.803036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:46.805764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 391/797] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:46.806721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.897685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9166986-a9dd-4fa5-9f78-e870aef859d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.913176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab910a3-4bf3-4b0b-88c4-a3479e72c67e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:46.924225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:46.936522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.937320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.937606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.937888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.947449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:46.948369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.948645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.948918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.950120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.952480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.957041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:46.958457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:46.970036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:46.970910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:46.972589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:46.972589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:46.972589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:46.972589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:46.972589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 407/798] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:46.972589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-28a06d59-b6c5-488e-9d31-89dfcec6ffa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:46.974627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:46.975710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:46.976938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:46.978364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 392/799] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:46.978694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15d97-9a4b-4df6-945b-1568b384fe5b None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:46.978990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15d97-9a4b-4df6-945b-1568b384fe5b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:46.979833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15d97-9a4b-4df6-945b-1568b384fe5b None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:46.985152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 393/800] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:46.985152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15d97-9a4b-4df6-945b-1568b384fe5b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.001340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.089048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af653-c6ce-4a0c-ad22-325f2f6b630e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.093811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15d97-9a4b-4df6-945b-1568b384fe5b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.124848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.125463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.125746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.126029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.126808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.127113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.128559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.132033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.132761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.133082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.133354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.134520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.134832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.136198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa9811-832b-4979-b17e-b9949e46fcce None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.142216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 408/801] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.142216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.158578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 394/802] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.158578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.158578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.158578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.175367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:47.176572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:47.201448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.227708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.247656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 395/803] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:47.249982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606417a-bda5-43dd-b9fa-e9b2d8ce6d2d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.253649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.293902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.294563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.294844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.295117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.295964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.296508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.297693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.316133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 409/804] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.316943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.357322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857f465-405c-4ea1-960a-75fe5d88f155 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.390524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.391311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.391590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.391860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.401692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.403829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.416044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbb3c5-450c-4fe0-b8c9-e3f1b1196653 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:47.421404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:47.422457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:47.423373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:47.423373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:47.423373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:47.423373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:47.423373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 396/805] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:47.423373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.438691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.451068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.451949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.452238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.452513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.455425 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.459802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.461263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fb70e94b-65bb-4cde-bc0b-21df20d8cf87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:47.475585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:47.476700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:47.477959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 410/806] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:47.478466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d5cbd-92cf-470f-8355-1d2bd9429294 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.478466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d5cbd-92cf-470f-8355-1d2bd9429294 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.478661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d5cbd-92cf-470f-8355-1d2bd9429294 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.479904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 411/807] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:47.481283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d5cbd-92cf-470f-8355-1d2bd9429294 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.529922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06381472-0e68-48b1-937a-35d2a1ebb4ee None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.565385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.566189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.566468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.566740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.567386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.568779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:47.582710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:47.583887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:47.584983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 397/808] 10.222.0.45 () {56 vars in 1129 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:47.586101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.587406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d5cbd-92cf-470f-8355-1d2bd9429294 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.622315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.623103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.623384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.623658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.633880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.635322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:47.652452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:47.653626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:47.654647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:47.654647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:47.654647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:47.654647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:47.654647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 412/809] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:47.654647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.664168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.692308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788bd53-8d7e-498d-90bf-c109c53d4549 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.703960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.725358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.726017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.726298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.726573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.727291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.727596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.729006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e0e62-18cc-47c8-836b-fc932253de06 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.741148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 398/810] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.742338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.742623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.743148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.754717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d5d85-8229-4abd-97fe-f0b4226ab678 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.761274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:47.762681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:47.787970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.788565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.788848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.789123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.789909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.790218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.791723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.804482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 413/811] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.805277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.832296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 399/812] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:47.833135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.898776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.914395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775811ea-123d-4418-b8b8-b8ca5548b92c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.924193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:47.931827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea63f91-acb6-4e39-9d4f-6d764f8ef7ff None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:47.947766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.948444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.948724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.949049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.949738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.950033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.951391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.955659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 414/813] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.956579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:47.965630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af112-2713-489c-9b02-0c783d17258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:47.966294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af112-2713-489c-9b02-0c783d17258c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:47.966576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af112-2713-489c-9b02-0c783d17258c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:47.966852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081af112-2713-489c-9b02-0c783d17258c None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:47.967644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af112-2713-489c-9b02-0c783d17258c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:47.967989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af112-2713-489c-9b02-0c783d17258c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:47.969365 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081af112-2713-489c-9b02-0c783d17258c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:47.980987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 400/814] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:47.981598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af112-2713-489c-9b02-0c783d17258c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.058864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022debb-39ed-40a0-bfec-36f8367192d7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.086303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081af112-2713-489c-9b02-0c783d17258c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.092294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.093070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.093345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.093625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.100839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.102331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.113648 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:48.117189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:48.118390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:31:48.119344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:48.122495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.123454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 415/815] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:31:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:48.123559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.123664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.130163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/5d4c20c5feaa4da8835fa8b5ffc1ac9f/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.130277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.139497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=5d4c20c5feaa4da8835fa8b5ffc1ac9f, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.140936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.154375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.215425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 401/816] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:47 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/5d4c20c5feaa4da8835fa8b5ffc1ac9f/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:48.216358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.219730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2844c-e448-4c7e-847d-33315c45d118 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.260415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.261272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.261588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.261863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] PATH_INFO: `/v3/services/network` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.262651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.264274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:48.277899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:48.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:48.279848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 416/817] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:48.281358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.349669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc123e-b72b-4d03-a931-c71900e68f33 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.390140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.393598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.394266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.394551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.394825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.395532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:48.395709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa12f7-17a1-46f9-a051-375f617a842b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.395871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.397231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.403883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 402/818] 10.222.0.45 () {56 vars in 1124 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:48.403883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.430668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.431516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.431799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.432141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.438959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.440443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.451686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:48.454608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:48.455660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:48.456630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 417/819] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:48.457105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.520336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3dbc8-a2b1-4dd6-8e2b-266db28ad69d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.556392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.557246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.557621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.558021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.559340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:48.559844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.561309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.571756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53d991-be7a-4c3c-93c5-92db54ada2d4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.585641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 403/820] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:48.585641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.608382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.608972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.609260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.609540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.610244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] RBAC: Adding query filter params (name=network) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:48.610554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.611955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.621460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 418/821] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:48.621460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.647474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.694542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.698528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81a9d7-4295-4e38-8db4-86bbd21b5461 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.734999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.736153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.736379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd54f8e-3d96-493c-9d97-80f9870e5646 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.736639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.737396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.738310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.740524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.772238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.772894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.773218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.773490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.774274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:48.774587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:48.776028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:48.793641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 419/822] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:48.793641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.849132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 404/823] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:31:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:48.849965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:48.889994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:48.918969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd321-2de5-4197-b65b-3add4c69e340 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:48.966319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:48.967077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:48.967474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:48.967825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:48.982531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82cc053-dd08-4a84-8051-254924b8c0fb None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:49.020900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:49.021591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:49.021985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:49.022273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:49.022993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] RBAC: Adding query filter params (type=network) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:49.023306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.024831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.031494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 405/824] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:49.032340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:49.056428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.058277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.058677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:49.143950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:49.169653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a546bff-7056-491b-a402-526a72b56c92 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:49.172977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 420/825] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:31:49.173656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:49.212314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:49.213189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:49.213465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:49.213735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/137aecde49064a4abf74de30e9a85875/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:49.216570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=137aecde49064a4abf74de30e9a85875, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.217998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.280698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 406/826] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:31:49 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/137aecde49064a4abf74de30e9a85875/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:31:49.282135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:49.310951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f8189-e2ba-44e1-a393-2dda15b68fd0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:49.385097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:49.392670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:49.393722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:49.394229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:49.394679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:49.395604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.397204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.411216 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad880c-df9b-400a-a223-c99e947928bc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:49.454957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:49.455827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:49.456141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:49.456418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:49.471268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.474980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:49.491736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:49.493022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:49.494907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:49.494907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:49.494907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:49.494907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:49.494907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 407/827] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:49.503018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:49.511474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 421/828] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:31:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:31:49.627707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af3577-135d-4f18-9de8-757c0f7abb33 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:49.663984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:49.680773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:49.681462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:49.681745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:49.682020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:49.689996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:49.690311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.691849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.711788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 408/829] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:49.718137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:49.754620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:49.832181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe36f9-6df2-448a-9e8f-9fb2591d9370 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:49.874527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:49.875683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:49.876239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:49.876711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:49.885117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:49.887607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:49.902862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:49.903774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:49.904719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:49.907240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 422/830] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:49.913122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:50.036847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2434b6-5423-4a11-baa6-b3a6c3395022 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:50.074773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:50.082300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.082300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.082300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.082300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:50.082300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:50.082300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d737-2e69-454c-a51d-7bbb77a9e1f5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:50.092408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 409/831] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:50.098495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:50.198462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:50.207858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819be97-ee10-4a39-a49d-f72e47f86349 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:50.245901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:50.247005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.247495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.248002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.249089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=62eba0e2bd914eeb949bb434f8a6cd9c) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:50.249631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:50.251337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe308a-2dd1-441f-b8fb-423df4f8ee6f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:50.259794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 423/832] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:50 2022] GET /identity/v3/role_assignments?user.id=62eba0e2bd914eeb949bb434f8a6cd9c&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:50.288128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c302a6-ffd5-4480-a296-73c4c6bf54fa None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.288745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c302a6-ffd5-4480-a296-73c4c6bf54fa None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.289246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c302a6-ffd5-4480-a296-73c4c6bf54fa None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.291235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 410/833] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:50.297236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.297528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.297794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.317580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:50.318807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:50.394256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 424/834] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:50.417568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c302a6-ffd5-4480-a296-73c4c6bf54fa None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:50.468023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:50.524641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c302a6-ffd5-4480-a296-73c4c6bf54fa None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:50.559326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:50.560084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.560364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.560638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.571661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:50.579811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:50.580822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:50.581683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 411/835] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:31:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:50.587341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:50.681245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:50.703432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e6dea-16da-49c3-a7b0-57be7ef7453d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:50.738369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:50.739036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.739361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.739640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.740416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:50.740719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:50.742089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:50.750933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 425/836] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:31:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:50.756559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:50.863587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb775ed1-6544-40be-ba54-033960468325 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:50.872153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:50.899759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:50.900913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:50.901422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:50.902569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:50.912988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:50.914652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:50.932432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:50.933639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:50.934565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:50.934565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:50.934565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:50.934565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:50.936798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 412/837] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:50.942131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.049234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa522fd-9a2e-4917-b052-bc296616ce80 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.083598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.084642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.085143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.085614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.086539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:51.087056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.088640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656e3d7-f78f-414a-90cb-0880dd4aa777 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.102060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 426/838] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:51.109080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.211752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722ed48-00af-46aa-b0f8-0734d7ec4f14 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.212090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacbc5-a2ab-40cb-b7b1-3dc7a443554c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.212473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacbc5-a2ab-40cb-b7b1-3dc7a443554c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.212855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eacbc5-a2ab-40cb-b7b1-3dc7a443554c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.215182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 427/839] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:51.220571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.222595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.222595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.240876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:51.242080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:51.244583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:51.251082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.252238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.252721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.253205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.261477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.263272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:51.279460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:51.280516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:51.281854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 413/840] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:51.286277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.309505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:51.328026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 428/841] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:31:51.347022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.401130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135971-e756-4636-9104-8b4abf8017f4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.446723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.447743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.448296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.449493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.450587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:51.451169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.452826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.472521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 414/842] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:51.472701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df1395-8a50-4b29-999b-2d367c662b43 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.477659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.508654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.509242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.509527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.509801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.510459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.512394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:51.524833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:51.525887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:31:51.526886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:51.531625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 429/843] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:51.532882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.535692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:51.569651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:51.600215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927a501-bf98-433d-99cb-48ac62b851fe None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.640351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92de7eb-e13f-456f-a733-e5a27662673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.641419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de7eb-e13f-456f-a733-e5a27662673f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.641529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3952877-50a8-425f-bfda-c327d0fb787e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.642399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de7eb-e13f-456f-a733-e5a27662673f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.642969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92de7eb-e13f-456f-a733-e5a27662673f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.677513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.678232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.678538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.678847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.679509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:51.679818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.681246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.687086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 430/844] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:51.693174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.725115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92de7eb-e13f-456f-a733-e5a27662673f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.726948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92de7eb-e13f-456f-a733-e5a27662673f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.759219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:51.796125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bdcfd-3ff9-4468-bebd-c37335eb16fd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:51.805104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:51.835967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 415/845] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:31:51.835967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc603-aecd-42ac-a461-96821a6af8b8 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.835967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc603-aecd-42ac-a461-96821a6af8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.835967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6abc603-aecd-42ac-a461-96821a6af8b8 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.836318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:51.836437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 416/846] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:51.836513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.836513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.836513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.836513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:51.836513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:51.836513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224abb1f-57d9-43e6-8e68-4f454a4a20b2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:51.839336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc603-aecd-42ac-a461-96821a6af8b8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:51.844878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 431/847] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:51.863952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:51.863952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:51.863952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:51.880378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:51.881671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:51.960084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 432/848] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:51.984453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.000707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6abc603-aecd-42ac-a461-96821a6af8b8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.045711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.046656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.047068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.047439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.055793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.058705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.060422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:52.079314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:52.080448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:52.081346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:52.081346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:52.081346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:52.081346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:52.081887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 417/849] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:52.087259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.101800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873eca6-5909-46c9-aee0-048038e171fe None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.117503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.140236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.141133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.141476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.141879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.152840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:52.162056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:52.163179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:31:52.164244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:52.166669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 433/850] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:52.176785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.204593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e18b4-752b-4c60-be45-452968ffc458 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.241524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.242512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.243244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.243718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.244666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:52.245192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.247112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.259618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 418/851] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:52.265605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.289703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3005cd6-a8b0-476d-af39-8ee3befe68da None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.317167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.336187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.337259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.337547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.337823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.338952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:52.339336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.340723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.356000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 434/852] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:52.358078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.373632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.387876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec41a-6131-4b11-b3ab-72fc0e27f596 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.428789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.429594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.429880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.430156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.438007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.439463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:52.454697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:52.455638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:52.456557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:52.460764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 419/853] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:52.462066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.487262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f11c6-2b4c-4d1f-9628-5d2f69b86e26 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.525324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.526040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.526324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.526597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.538144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.539600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ad4fa0a2-8ffa-45f1-aa42-070984d24698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:52.557674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:52.559179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:52.560522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:52.560522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:52.560522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:52.560522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:52.564080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 435/854] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:52.565562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38473e-2f3f-4c8e-96f9-1f62164f5d7f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.565850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38473e-2f3f-4c8e-96f9-1f62164f5d7f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.566125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38473e-2f3f-4c8e-96f9-1f62164f5d7f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.567961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 436/855] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:52.568135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38473e-2f3f-4c8e-96f9-1f62164f5d7f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.575354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c73ea-4b7c-4a5d-af59-a9133e1eb831 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.606395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.613318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.614341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.614778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.620158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.620158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:52.620158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.620158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098446c1-96f1-4d00-9fad-011779e97b8c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.636889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 420/856] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:52.636889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.636889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.636889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.653182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:52.654392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:52.656586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.683334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38473e-2f3f-4c8e-96f9-1f62164f5d7f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.722743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.723814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.724366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.724864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.726084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:52.726619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.728133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.731193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 421/857] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:52.732644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.741648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 437/858] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:52.747333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.844290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.850212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69279bd2-6016-4d43-b91e-6b5fa8c43676 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.855872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a972f-fbbc-4600-aec2-e860824d16e7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:52.888045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.888704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.888988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.889088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:52.889272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.889853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:52.890086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:52.890183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:52.890387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:52.890490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.891816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.897646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 422/859] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/role_assignments?user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:52.898421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:52.901035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:52.905092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:52.906584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:52.928346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:52.929373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 12:31:52.930323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:52.932832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 438/860] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:52.940847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.020463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a0296-255a-4731-93fb-314ec9f83f16 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.065121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeccb6a-c3f3-4fd6-9a89-7d2bafd44ef4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.067324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.068877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.069953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.069953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.070121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.071445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:53.087231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:53.088343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:31:53.089226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:53.094063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 423/861] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:53.094901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.111017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.111690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.112007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.112285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.113126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:53.113489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.114917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.137717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 439/862] 10.222.0.45 () {56 vars in 1135 bytes} [Mon Jul 25 12:31:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:53.145350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.165057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:53.180251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:53.227214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa23c9-d175-46e5-9eb4-eefc36a26861 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.269796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.270409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefb89b-3c37-459f-b6e9-9f9e728257c8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.270965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.271423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.272083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.273771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:53.274280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.275844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.282686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 424/863] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:31:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:53.288374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.310861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.311802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.312291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.312745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.396641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c70f2-a205-40e1-a6cc-16c84f84f29c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.400920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.402872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.421008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:53.427644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:53.441009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.441984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.442449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.442902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.443837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:53.444454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.446074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.452498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 425/864] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:31:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:53.533579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 440/865] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:31:53.539690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.649705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18992b6-0e1c-46b9-be4b-829b1989a28c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.687822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.688675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.688961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.689238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.701484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.702951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:53.721498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:53.722454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:53.723358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:53.723358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:53.723358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:53.723358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:53.723358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 426/866] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:53.730366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.836637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcff07-f996-450c-89a0-8c43768ad21e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:53.851338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:53.874671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:53.875333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.878299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.878299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.878299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:53.878299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:53.878565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e7cb1-0ada-4390-a436-1e12967d69fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:53.891792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 441/867] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:53.901090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:53.940526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d91d-6018-42da-922a-ed7dc3aa5056 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.940835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d91d-6018-42da-922a-ed7dc3aa5056 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.941087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6d91d-6018-42da-922a-ed7dc3aa5056 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.942583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 442/868] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:53.947476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:53.947759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:53.948060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:53.955438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:53.969121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:53.977334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:54.022739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661721ec-22fa-4265-a1b7-b7c6fc0523b4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:54.067098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:54.067902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:54.068215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:54.068494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:54.070639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 443/869] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:54.076145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:54.077682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:54.090279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:54.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:54.095812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:54.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 427/870] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:54.105818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:54.207872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc3e2c-f991-47e1-be6a-678370bcb63c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:54.209583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:54.245119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64a33-f6f9-4b7b-a8e7-e3d4ca74ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:54.245822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64a33-f6f9-4b7b-a8e7-e3d4ca74ab52 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:54.246103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64a33-f6f9-4b7b-a8e7-e3d4ca74ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:54.246376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64a33-f6f9-4b7b-a8e7-e3d4ca74ab52 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:54.247104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64a33-f6f9-4b7b-a8e7-e3d4ca74ab52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:54.248152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea32868-428a-4700-a1dd-3abd8586d436 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:54.248616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64a33-f6f9-4b7b-a8e7-e3d4ca74ab52 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:54.257429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:54.283930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:54.284596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:54.284877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:54.285146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:54.285917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:54.286223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:54.287632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:54.299741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 428/871] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:54.305662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:54.322612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 444/872] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:31:54 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:31:54.433992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b560f8-1c9b-45bc-928e-9f591dacee08 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:54.479479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:54.480131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:54.480417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:54.480689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:54.481524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=137aecde49064a4abf74de30e9a85875) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:54.481836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:54.483266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80b1b4-1050-474c-bf1d-b7595d114419 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:54.489734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 429/873] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:54 2022] GET /identity/v3/role_assignments?user.id=137aecde49064a4abf74de30e9a85875&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:55.123274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56f6b-1d87-469a-9c54-aa2c495ec6f4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.123809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56f6b-1d87-469a-9c54-aa2c495ec6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.124134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56f6b-1d87-469a-9c54-aa2c495ec6f4 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.125920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 445/874] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:55.131260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.131662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.132073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.150529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:55.151743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:55.177604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:55.225522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 430/875] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:55.248869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56f6b-1d87-469a-9c54-aa2c495ec6f4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:55.355329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56f6b-1d87-469a-9c54-aa2c495ec6f4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:55.391180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:55.391905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.392211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.392484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.403405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:31:55.411603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:55.412567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:55.413415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 446/876] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Jul 25 12:31:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:55.419185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:55.527276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848c372-65d5-48e4-85de-3ff1bb716fd7 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:55.562986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:55.563668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.563969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.564249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.565009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:55.565318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:55.566684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa20c22-7711-4d53-a103-4de09577b7c4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:55.575586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 431/877] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:31:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:55.581093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:55.602492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5fc9-7b73-4a7b-9fb7-0c8ead80b453 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.602792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5fc9-7b73-4a7b-9fb7-0c8ead80b453 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.603052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc5fc9-7b73-4a7b-9fb7-0c8ead80b453 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.605498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 432/878] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:55.611109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:55.612220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.612510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.612788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.638639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:55.640635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:55.655422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:55.705442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b2204-4d5f-4479-9d55-af582d2e269d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:55.727942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 433/879] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:31:55.745927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:55.749421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:55.750219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.750726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.750726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.763235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:55.765005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:55.788310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:55.789243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:55.790133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:55.790133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:55.790133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:55.790133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:55.790133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 447/880] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:55.796508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:55.872034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3626d-73c5-4399-a1e9-e6fd1b10cb97 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:55.885054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:55.909132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:55.909770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.910007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.910283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.911007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:55.912608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:55.915458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291958a-a15d-44ca-8b08-436f75990b6b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:55.953545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:55.954305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:55.954654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:55.955001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:55.955846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:55.956363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:55.957698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:55.970368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 448/881] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:55.975786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:55.984948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 434/882] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:31:55 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:31:56.103001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c19c-40d7-40fd-9611-b4141b54ee50 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:56.144887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:56.150630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:56.151601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.152319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.152591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.166937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:56.166937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:31:56.176888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:56.177888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:56.178853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 449/883] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:31:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:56.184219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:56.196546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:56.300388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfea72f-9ad0-4771-ac33-956a551c50e2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:56.336757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:56.337834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.338349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.338838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.340619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:56.341285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:56.342924 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb223f8-2c85-4c0f-91cc-372bfddb9222 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:56.362299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 435/884] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Jul 25 12:31:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:56.369026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:56.444164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6d22-8a38-4f70-9983-76702bcb0cb0 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.444659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6d22-8a38-4f70-9983-76702bcb0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.444659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6d22-8a38-4f70-9983-76702bcb0cb0 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.446218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 436/885] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:31:56.451680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.451995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.452277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.472699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:56.474341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:56.479337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61812d6f-bf85-4781-83b6-98e4d840b01a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:56.519538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930f679-0fc6-4514-af80-123e7247736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:56.519538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f679-0fc6-4514-af80-123e7247736d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.519538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f679-0fc6-4514-af80-123e7247736d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.519538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930f679-0fc6-4514-af80-123e7247736d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.549147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:56.564079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 437/886] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:31:56.584902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:56.592523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:56.605452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930f679-0fc6-4514-af80-123e7247736d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:56.606923 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930f679-0fc6-4514-af80-123e7247736d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:56.709713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164a49d-274f-4c14-83fd-93d028303b11 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:56.731193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 450/887] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:31:56 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:31:56.731193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc546-a814-4c6e-b0da-a66fe8e9d78c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.731193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc546-a814-4c6e-b0da-a66fe8e9d78c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.731193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc546-a814-4c6e-b0da-a66fe8e9d78c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.731193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 451/888] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:56.735005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc546-a814-4c6e-b0da-a66fe8e9d78c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:56.750699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:56.751502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.751781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.752093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.752767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:56.754125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-4474b47a-ba17-42b4-bc68-b63a6a13e042 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:56.765992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:56.766997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:31:56.768099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 438/889] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:31:56.769360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.769360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.769360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.786205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:56.787378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:56.835951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:56.844685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:56.848603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc546-a814-4c6e-b0da-a66fe8e9d78c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:56.855877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 439/890] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:56.856713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:56.897146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:56.897934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:56.898211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:56.898480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:56.909081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:56.910521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:31:56.929277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:56.930207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:56.931113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:31:56.931113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:31:56.931113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:31:56.931113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:56.931113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 452/891] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:56.931392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:56.970255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169da08-5b99-48de-842f-d3f22b74df47 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.005281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.005940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.006218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.006489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.007187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.007500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.008879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.014113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 440/892] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.014881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.043067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d6592-9ad0-4123-b6df-610d3e9851e8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.073289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.079694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.080531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.080818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.081094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.081750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.083268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:57.096438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:57.097465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:31:57.098343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:57.102772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 453/893] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:31:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:57.103890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.113730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.123308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07037-2a00-4698-8581-41cfa8f15eb2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.160550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.161212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.161495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.161772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.162486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.162790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.164175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.175511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 441/894] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.176347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.208221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10a92a-fc24-4d8d-888f-ba27bd052d72 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.246479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.247155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.247439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.247718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.248546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.248858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.250232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.260412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 454/895] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.260412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.293687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc003d02-b7b3-4764-874b-6b2c364e0418 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.309273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.329461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.330109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.330224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.330389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.341493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.341493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.341493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.341493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.341493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 442/896] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.341493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.367761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd5813-87b4-4fa1-90a4-8a2cd600fc74 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.404752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.405744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.406033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.406315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.412922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.414354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:31:57.429319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:57.430208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:57.431083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 455/897] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:57.431567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.456754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5b498-fc2b-46bf-9974-0359e48c12cb None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.492055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.492965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.493252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.493527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.494315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] RBAC: Adding query filter params (interface=public, service_id=a2dc090adf074a35a3d3c64436b274c1, region_id=RegionOne) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.494632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.496770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.506483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 443/898] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/endpoints?service_id=a2dc090adf074a35a3d3c64436b274c1&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.506483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.545112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce348e-ea31-4bab-8a43-38721ff926e3 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.550176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.580397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.586249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.586964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.587241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.587514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.588463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.588579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.589938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.594400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 456/899] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.595165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.626349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076fe44-2df9-443f-974e-6e07fcafb4bf None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.682223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.684202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.684961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.685688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.687549 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.688131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.689869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.709174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 444/900] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:57.715715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:57.719332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972044d-18d9-4e26-9701-7299799b9cf4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.768915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68de5-7a63-45d6-b6ee-f11270403295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.769514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68de5-7a63-45d6-b6ee-f11270403295 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.769861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68de5-7a63-45d6-b6ee-f11270403295 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.770494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68de5-7a63-45d6-b6ee-f11270403295 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.771044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68de5-7a63-45d6-b6ee-f11270403295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.772457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68de5-7a63-45d6-b6ee-f11270403295 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.779988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 457/901] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:31:57.842720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9457b-8af8-4736-9c72-e3aff84c5634 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:57.844416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:57.884169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:57.885217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:57.885743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:57.886508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:57.887641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] RBAC: Adding query filter params (role.id=a5700d33578b4c708295af61b791a84e, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:57.888218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:57.890273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b357de2-6f92-410d-9c64-9437867cb5b0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:57.897460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 445/902] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:31:57 2022] GET /identity/v3/role_assignments?user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=a5700d33578b4c708295af61b791a84e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:31:58.146280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55385b-e14d-405b-b134-9fda72b7e737 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:58.146636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55385b-e14d-405b-b134-9fda72b7e737 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:58.146741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55385b-e14d-405b-b134-9fda72b7e737 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:58.148356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 458/903] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:58.154414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:58.154699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:58.154977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:58.173136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:58.174314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:58.242911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 446/904] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:58.265369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55385b-e14d-405b-b134-9fda72b7e737 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:58.332819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:58.383080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55385b-e14d-405b-b134-9fda72b7e737 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:58.419864 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:58.420646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:58.420927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:58.421217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:58.421856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:58.423223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:31:58.435655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:31:58.436643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:31:58.438136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 459/905] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Jul 25 12:31:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:31:58.442792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:58.545965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b432b08-5504-4706-9003-3b02a4bff8d8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:58.568285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:58.582640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:58.583436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:58.583773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:58.584023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:58.584741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:58.585063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:58.586544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:58.592102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 447/906] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:31:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:58.597826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:58.713243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979225f-2e41-4ec2-861e-020e6975ab51 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:58.736875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:58.749362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:58.750030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:58.750308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:58.750581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:58.751292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:58.751594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:58.753045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:58.758650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 460/907] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:31:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:58.764617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:58.877373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d2fba-293d-4410-85bb-841ac7eb57d7 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:58.913249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:58.914232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:58.914726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:58.915227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:58.916356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] RBAC: Adding query filter params (interface=public, service_id=353f83e8bda648bf96b4bbc5bdcd0bd9, region_id=RegionOne) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:31:58.916904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:58.918561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12355f74-f9b3-46f3-888f-95c137dc654f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:58.924334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 448/908] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:31:58 2022] GET /identity/v3/endpoints?service_id=353f83e8bda648bf96b4bbc5bdcd0bd9&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:31:58.935974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:59.050356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ce9d8-c00d-4243-9e1a-921e380bf2f8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:59.085487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebdd77-9a2a-44da-acf7-d8743683294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:59.086174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebdd77-9a2a-44da-acf7-d8743683294f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:59.086455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebdd77-9a2a-44da-acf7-d8743683294f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:59.086727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebdd77-9a2a-44da-acf7-d8743683294f None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:59.087418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebdd77-9a2a-44da-acf7-d8743683294f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:59.089434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebdd77-9a2a-44da-acf7-d8743683294f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:59.096615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 461/909] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:31:58 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:31:59.696970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40821073-52e2-4e2f-9e3d-67acd2bb8624 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:59.697457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40821073-52e2-4e2f-9e3d-67acd2bb8624 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:59.697558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40821073-52e2-4e2f-9e3d-67acd2bb8624 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:59.699699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 449/910] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:59.704954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8cc3-bab7-43c5-9837-08349af49f98 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:59.705387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8cc3-bab7-43c5-9837-08349af49f98 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:59.705491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a8cc3-bab7-43c5-9837-08349af49f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:59.724610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f64a8cc3-bab7-43c5-9837-08349af49f98 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:59.725801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f64a8cc3-bab7-43c5-9837-08349af49f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:31:59.772738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:59.799177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 462/911] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:31:59.821554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40821073-52e2-4e2f-9e3d-67acd2bb8624 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:31:59.848047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:31:59.933986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40821073-52e2-4e2f-9e3d-67acd2bb8624 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:31:59.962688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2472398-6994-4fbb-839a-0218f672c81b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:59.963307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2472398-6994-4fbb-839a-0218f672c81b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:59.963997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2472398-6994-4fbb-839a-0218f672c81b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:59.966191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 463/912] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:31:59.969615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50362c9-f568-4087-bf24-037724d8740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:31:59.970508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50362c9-f568-4087-bf24-037724d8740b None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:59.970975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50362c9-f568-4087-bf24-037724d8740b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:59.971097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:31:59.971429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:31:59.971746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50362c9-f568-4087-bf24-037724d8740b None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:59.971855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:31:59.972759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50362c9-f568-4087-bf24-037724d8740b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:31:59.974304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50362c9-f568-4087-bf24-037724d8740b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:31:59.990588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:31:59.997895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:00.060545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 450/913] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:31:59 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:00.063075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45982e02-bdf5-4577-a328-c136f388e8f6 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.063608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45982e02-bdf5-4577-a328-c136f388e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.063942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45982e02-bdf5-4577-a328-c136f388e8f6 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.066031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 451/914] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:00.075187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.076119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.077978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.088444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 464/915] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:31:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:00.103220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:00.104801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:00.107483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.190594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 452/916] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:00.217912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.221904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f8e29-e00b-4eb8-a5f6-9ebd49de2d80 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.230747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:00.234373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:00.267780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.268620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.268901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.269176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.269882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.271427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:00.284370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:00.285489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:00.286407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 465/917] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:00.291938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.348819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f11fe7-16b5-4b4a-afed-4831a8a28c14 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.400161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.401525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.401965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.402282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.402631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d1703-7680-481d-a2b8-3359b54f152e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.416052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:00.427806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:00.428902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:00.429769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:00.430442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 453/918] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:00.437493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.442999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.443706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.451940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.451940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.451940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:00.451940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.451940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.457434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 466/919] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:00.458718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.495093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:00.540596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:00.544483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1ded7-76bd-487f-b003-85e68ab23b99 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.566865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac44609-f0ee-4da1-9381-47a1b6be6805 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.587701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.590185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.590471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.590747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.591505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:00.591811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.593214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.602646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 454/920] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:00.609064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.613309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.613988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.614270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.614547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.615252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:00.615558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.617027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.623965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 467/921] 10.222.0.45 () {56 vars in 1114 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:00.628909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.730276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06103-e744-418c-9c7f-fd3b9f024188 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.749612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:00.754435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e37955-f18e-42d2-aa16-db38184dab3c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.767421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.773726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.773726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.773726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.773726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:00.782128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.783801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.792847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.793732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.794165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.794587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.795565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.797149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:00.802124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:00.803193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:00.804167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:00.804167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:00.804167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:00.804167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:00.804167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 455/922] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:00.809393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:00.917709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa180-0508-4cb5-84c1-ac21b9764f99 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:00.924098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 468/923] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:32:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:00.973500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:00.974560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:00.975092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:00.975584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:00.976566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:00.977104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:00.978714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56bbd1-a2ce-4fe6-87ee-d0acb721bf74 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:00.994247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 456/924] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:01.000676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.117026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef047728-9810-4a8a-bf23-ad2df4ab8072 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.154637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.155463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.155745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.156061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.159104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440c533-7e8f-47e2-a433-828578150b0f None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.159397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440c533-7e8f-47e2-a433-828578150b0f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.159678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440c533-7e8f-47e2-a433-828578150b0f None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.161340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 457/925] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:01.164930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.166317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.166441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.166836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.167217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:32:01.182198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:01.183446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:01.184819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 469/926] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:32:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:01.189678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.192618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:01.193882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:01.208196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:01.244024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:01.281826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 458/927] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:01.306095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f0d82-f815-407b-b96c-ad36a7fd27b5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.309690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.361342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.362643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.363512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.364039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.365110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:01.365623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.368360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.394108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 470/928] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:01.399265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.427754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbca31-53f6-4480-a2e3-36bb05fe8813 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.466129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.467373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.467865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.468386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.469274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.470846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:01.484223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:01.485225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 12:32:01.486074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:01.488075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:01.495489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 459/929] 10.222.0.45 () {56 vars in 1132 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:01.496836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.529284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918f29e-7901-462d-b9c1-fd12fb51e3ed None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.545288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:01.567306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.568468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.568960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.569440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.582576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.584562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:01.604538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:01.605835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:01.606753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:01.606753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:01.606753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:01.606753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:01.613829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 471/930] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:01.615042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.617337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44328f-6a4d-4abb-b4f7-e16181292518 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.658923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.659987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.660499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.661000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.661924 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:01.662448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.664088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.675820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 460/931] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:01.677140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.735023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e87810-a68b-47cb-a985-89231855dae6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.762972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:01.774903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.781019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.781019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.781019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.781019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:01.781019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.781019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.796095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 472/932] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:01.799117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.818325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449df73-e169-4381-95db-0ba098d5d57b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.820143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:01.864074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.864744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.865025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.865297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.866260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:01.866573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.868882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.879952 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 461/933] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:01.881566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:01.924678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856060a-bc26-4973-9f99-573205c41f8a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:01.966791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:01.967579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:01.967863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:01.968170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:01.976819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:01.978697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:32:01.996241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:01.997169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:01.998072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:01.998982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ecce8-4594-48f0-a3b3-ddff78f42fa2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:02.005531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 473/934] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:02.006715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:02.039317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad0827-6ae2-4e65-8738-b82a4c5f9d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:02.040011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0827-6ae2-4e65-8738-b82a4c5f9d13 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.040295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0827-6ae2-4e65-8738-b82a4c5f9d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.040567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad0827-6ae2-4e65-8738-b82a4c5f9d13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.041469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0827-6ae2-4e65-8738-b82a4c5f9d13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:02.043874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad0827-6ae2-4e65-8738-b82a4c5f9d13 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:02.060531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:02.116273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8420e93-102d-405a-a78b-72d741ff9f75 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:02.149862 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 462/935] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:32:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:02.165978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01bd4f-d052-43da-96ab-971d58e05b70 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.166327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01bd4f-d052-43da-96ab-971d58e05b70 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.166664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01bd4f-d052-43da-96ab-971d58e05b70 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.169085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 463/936] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:02.175589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.175957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.176275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.188025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:02.188722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.189064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.189351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.190185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:02.190550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:02.192154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:02.202700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:02.205109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:02.208363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 474/937] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:02.215585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:02.234223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:02.311841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 464/938] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:02.334659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:02.346111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:02.349888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25207a9-15e2-41b2-a0e8-e1e0d6eb1196 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:02.406828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:02.408643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.409335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.409788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/5d4c20c5feaa4da8835fa8b5ffc1ac9f/roles/a5700d33578b4c708295af61b791a84e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.413024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=5d4c20c5feaa4da8835fa8b5ffc1ac9f, role_id=a5700d33578b4c708295af61b791a84e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:02.415027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:02.449290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9ae9b-6e53-4a97-9aeb-374893c4616d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:02.484942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:02.485758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.486134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.486412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.487110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:02.488628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:02.502398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:02.503425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:02.504314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 465/939] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:32:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:02.512111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:02.521176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 475/940] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:32:02 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/5d4c20c5feaa4da8835fa8b5ffc1ac9f/roles/a5700d33578b4c708295af61b791a84e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:32:02.537017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:02.638049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7fd32-e916-4050-9b53-2cb541e18bfc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:02.679374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:02.680092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.680441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.680724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.681479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:02.681798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:02.684355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:02.690142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 466/941] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:02.698869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:02.813146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327769c8-523c-4aa8-8ecc-4447f3fd2347 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:02.849699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:02.850366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:02.850651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:02.850929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:02.851637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:02.851964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:02.853341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:02.859767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 476/942] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:02.865527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:02.957981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:02.978629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81da4d-59d6-45e2-8a1b-97bebb494524 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:03.020509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:03.021169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.021447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.021722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.022513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] RBAC: Adding query filter params (interface=public, service_id=e7c700cafc7a48eca64e30a243b68e08, region_id=RegionOne) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:03.022823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:03.024229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3e04-9821-4df8-bd9f-8742c1cc4d0c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:03.030433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 467/943] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:32:02 2022] GET /identity/v3/endpoints?service_id=e7c700cafc7a48eca64e30a243b68e08&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:03.035898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:03.063192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:03.142696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79932e8-b21e-4336-a6c6-e3963f64a0e7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:03.182766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5f61-4ee6-4e9a-8bef-227198470bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:03.184130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5f61-4ee6-4e9a-8bef-227198470bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.184648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5f61-4ee6-4e9a-8bef-227198470bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.185131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5f61-4ee6-4e9a-8bef-227198470bb1 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.186033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5f61-4ee6-4e9a-8bef-227198470bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:03.187641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f5f61-4ee6-4e9a-8bef-227198470bb1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:03.194548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 477/944] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:32:03 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:32:03.208907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f610d1-b0c5-441e-9716-55176cd9d9b6 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.209526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f610d1-b0c5-441e-9716-55176cd9d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.210036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f610d1-b0c5-441e-9716-55176cd9d9b6 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.211739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 468/945] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:03.219192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.219477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.219802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.239577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:03.240848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:03.328104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 478/946] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:03.347149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f610d1-b0c5-441e-9716-55176cd9d9b6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:03.456156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f610d1-b0c5-441e-9716-55176cd9d9b6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:03.490967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:03.491633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.492002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.492281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.493312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:03.494806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:03.498161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING keystone.server.flask.common [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 12:32:03.514070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:03.569321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.sql.core [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 12:32:03.569321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 12:32:03.569321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [parameters: {'id': '1a2aa213ab454d3b9d202393a5084a35', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 12:32:03.569321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80496) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1a2aa213ab454d3b9d202393a5084a35.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1a2aa213ab454d3b9d202393a5084a35. Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:32:03.589273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application result.read() Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 12:32:03.590263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application yield resource Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise self.value Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application session.commit() Jul 25 12:32:03.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self.session.flush() Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application compat.raise_( Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:32:03.592140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 12:32:03.593026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application result.read() Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:32:03.593844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [parameters: {'id': '1a2aa213ab454d3b9d202393a5084a35', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:03.594707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:03.595489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1a2aa213ab454d3b9d202393a5084a35. Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:03.598673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 469/947] 10.222.0.45 () {60 vars in 1140 bytes} [Mon Jul 25 12:32:03 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:03.600059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:03.616797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:03.716808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f13cd-ff16-4d07-873d-771c7c3abc7a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:03.753265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:03.753987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.754271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.754550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.762562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:03.764046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d23b811d-343a-4975-863e-6fb9234d7ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:32:03.778571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:03.779457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:03.780433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:03.784308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 479/948] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:03.786356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:03.894170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b60ef3-38f8-41f8-8d08-9bab3878a903 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:03.928909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:03.929638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:03.929927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:03.930202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:03.930965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:03.931272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:03.933480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944a94c-5799-444a-bac2-13ebf644f489 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:03.960030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 470/949] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:04.267774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fef67-088c-4bac-8cf2-4a6db47bb54c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.268343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fef67-088c-4bac-8cf2-4a6db47bb54c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.268343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fef67-088c-4bac-8cf2-4a6db47bb54c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.269961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 480/950] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:04.275553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.275871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.276367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.295313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:04.296851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:04.359099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:04.371084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 471/951] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:04.392967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fef67-088c-4bac-8cf2-4a6db47bb54c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:04.484412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:04.509578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05fef67-088c-4bac-8cf2-4a6db47bb54c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:04.550924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:04.551637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.551937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.552219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.552877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:04.554251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4b6f2407-12cc-4f46-97d6-007d333ba464 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:04.570354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:04.571450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:04.572377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:04.575339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 481/952] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:04.581362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:04.581912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9657-731a-4686-90c0-0998336650c0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.582370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9657-731a-4686-90c0-0998336650c0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.582800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f9657-731a-4686-90c0-0998336650c0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.584848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 482/953] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:04.590223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.590507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.590780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.612983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:04.614845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:04.704289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 483/954] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:04.705903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c0ae0-a721-4b1e-af7b-e537536484a7 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:04.723598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:04.741801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:04.742730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.743013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.743289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.744124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:04.744437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:04.746335 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:04.756475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 472/955] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:04.757757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:04.818668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:04.837627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:04.856744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae718b7-0805-4425-96fb-13b7a40d104a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:04.892413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f2527-5f32-4de2-8b83-1a7d4cd8836e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:04.903027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:04.904738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.905228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.905702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.920163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:04.931427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:04.933182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:04.934151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:04.934808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 484/956] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Jul 25 12:32:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:04.940571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:04.941606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:04.942284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:04.942585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:04.942833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:04.943540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:04.943842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:04.945225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:04.957006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 473/957] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:05.061736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72de8-862f-427d-acfe-ba115eb9d0fe None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.094721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:05.099984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.100954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.101400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.110481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.110481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:05.110481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.110481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.114598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 485/958] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:32:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:05.121412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.230709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33cc9d-b603-4d50-8dcc-8afc7fdf7f2f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.250899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:05.269474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.270835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.271300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.272002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.283505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.285234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-49b845c7-2724-4e3c-910e-d286539c7f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:05.303027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:05.303979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:05.304929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:05.304929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:05.304929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:05.304929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:05.306908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 474/959] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:05.313169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.374857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237912-b0d7-4974-afd1-ac9f0c22e7a3 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.374857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237912-b0d7-4974-afd1-ac9f0c22e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.375137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237912-b0d7-4974-afd1-ac9f0c22e7a3 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.376793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 475/960] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:05.381677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.381963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.382240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.402491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:05.403601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:05.423618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825650-fff9-4690-b53a-dd54df19ca49 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.470401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.471729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.472417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.472861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.473984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:05.474827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.476663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.479446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 476/961] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:05.489213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 486/962] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:05.495575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.502874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.562204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:05.610133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565cc33-9be1-4b9a-bf93-c5d1ac7981e0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.632815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:05.638852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62b99c-87ec-4b56-8841-8ef76f65f120 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.652346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.653217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.653499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.653772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.654421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.655943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:05.669746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:05.670837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:05.671690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:05.676108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 487/963] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:05.677358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.681286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.688003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.688003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.688003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.701684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.703441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:32:05.719906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:05.720944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 12:32:05.721903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:05.724693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 477/964] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:05.732304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.812222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d83c9-a4ba-4e72-a0f2-17bf62cde638 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.833421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:05.860100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.860762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.861040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.861311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.862011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:05.862316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.863685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.873704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 488/965] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:05.874254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243309f-b2f9-43e4-9bf9-94196d3dbc14 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:05.874772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.920143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:05.921384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:05.922065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:05.922490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:05.923470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:05.924154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:05.926451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:05.950821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 478/966] 10.222.0.45 () {56 vars in 1149 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:05.955420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:05.978284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:05.993044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c095e-0b60-4a09-b54b-9dfed499bec7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.044711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.045785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.046246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.046987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.048469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:06.049235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.051051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.058049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 489/967] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:06.064079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.069451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3876c3-b74f-423d-a60d-5c5b65bce385 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.110693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dce95-4100-4c25-bac5-517d1fb09721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.111433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dce95-4100-4c25-bac5-517d1fb09721 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.111717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dce95-4100-4c25-bac5-517d1fb09721 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.112033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dce95-4100-4c25-bac5-517d1fb09721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.117906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:06.174118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbb6e-e63d-4927-9984-beff648ea3ed None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.188854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dce95-4100-4c25-bac5-517d1fb09721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.190438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dce95-4100-4c25-bac5-517d1fb09721 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.209352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48228c-be60-442b-aa75-aaaad4ae392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.209869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:06.210024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48228c-be60-442b-aa75-aaaad4ae392c None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.210265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48228c-be60-442b-aa75-aaaad4ae392c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.210537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48228c-be60-442b-aa75-aaaad4ae392c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.211281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48228c-be60-442b-aa75-aaaad4ae392c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.212656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48228c-be60-442b-aa75-aaaad4ae392c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.289768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 479/968] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:06.293508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b3d0f-d041-4832-8bed-da3a50c2984c None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.293802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b3d0f-d041-4832-8bed-da3a50c2984c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.294216 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b3d0f-d041-4832-8bed-da3a50c2984c None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.295542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 480/969] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:06.299104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b3d0f-d041-4832-8bed-da3a50c2984c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.317820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 490/970] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:32:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:06.319078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.319363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.319667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.343197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:06.344446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:06.442583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 491/971] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:06.452535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b3d0f-d041-4832-8bed-da3a50c2984c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.468590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.472500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:06.496900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.497872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.498157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.498499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.500387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:06.513781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.515513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:06.536786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:06.537729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:06.538624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:06.538624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:06.538624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:06.538624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:06.538624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 481/972] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:06.544001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.592880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a13868-564f-4951-8443-aeb4cfbb8f36 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.636895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.637938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.638754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.639267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.640496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.642548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.646219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING keystone.server.flask.common [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 12:32:06.663178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03ad03-840b-4ab3-ae33-8564d149e0f1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.700862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.sql.core [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 12:32:06.700862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 12:32:06.700862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [parameters: {'user_id': 'a486c43e6fc44fecb0feee5b081f06e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 12:32:06.700862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80497) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 12:32:06.705692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.706488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.706866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.707241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.708098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:06.708519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.709975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 25 12:32:06.710815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:32:06.711822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application yield resource Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application next(self.gen) Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise self.value Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application session.commit() Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 12:32:06.712914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.session.flush() Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application compat.raise_( Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 12:32:06.714742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 12:32:06.716247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application conn.query(q) Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application result.read() Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 12:32:06.717702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a486c43e6fc44fecb0feee5b081f06e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:06.720062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 12:32:06.721727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 12:32:06.724552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 12:32:06.724552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 12:32:06.724552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 12:32:06.724552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 12:32:06.724552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 12:32:06.724552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:06.726845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 492/973] 10.222.0.45 () {60 vars in 1131 bytes} [Mon Jul 25 12:32:06 2022] POST /identity/v3/users => generated 160 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:06.732885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.734027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 482/974] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:06.741001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.778103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:06.845157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:06.855492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9528d-c2d1-469e-8cc8-979b0937a4b4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.872151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb66f0-4fd9-46bf-a56b-76a309e561c2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:06.894897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.895729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.896048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.896650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.907579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.909560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.911562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:06.912442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:06.912724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:06.913004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:06.920919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:06.922360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:32:06.927636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:06.928600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 12:32:06.929578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:06.936987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 493/975] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:32:06.938418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:06.939336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:06.940645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:06.941443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:06.943998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 483/976] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:06.945584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:07.050032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:07.061593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eab87-cace-439d-9646-6c5d014c4745 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:07.063665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a90ac4-d15e-4a83-b16d-74f85baa7cb1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:07.098412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:07.098785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:07.099075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:07.099355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:07.099456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:07.099629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:07.099838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:07.100058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:07.100444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:07.100746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:07.100852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:07.101053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:07.102176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145904cd-0eb5-4c72-94c6-b6a0a3c2548a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:07.102452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14d71f-16f1-46bb-bd69-10c64d9026a1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:07.119552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 484/977] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:07.119552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08991-0ce1-43de-bf7d-2631a1b4048a None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:07.119552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08991-0ce1-43de-bf7d-2631a1b4048a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:07.119552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca08991-0ce1-43de-bf7d-2631a1b4048a None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:07.127228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 485/978] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:07.127228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca08991-0ce1-43de-bf7d-2631a1b4048a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:07.144744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 494/979] 10.222.0.45 () {56 vars in 1101 bytes} [Mon Jul 25 12:32:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:07.146110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:07.146402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:07.146677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:07.167244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:07.168875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:07.172392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:07.258424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 495/980] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:07.267435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca08991-0ce1-43de-bf7d-2631a1b4048a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:07.281398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:07.314385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:07.315117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:07.315489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:07.315842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:07.316801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] RBAC: Adding query filter params (role.id=a5700d33578b4c708295af61b791a84e, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:07.317191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:07.318717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb1e87-1333-47f4-897f-d81a30c15e20 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:07.327969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 486/981] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:07 2022] GET /identity/v3/role_assignments?user.id=5d4c20c5feaa4da8835fa8b5ffc1ac9f&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=a5700d33578b4c708295af61b791a84e => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:07.410637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc32edd-d458-443d-a64e-98deb795b4c0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:07.453990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e171c94-9005-42a5-a254-c952721bf34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:07.454987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171c94-9005-42a5-a254-c952721bf34a None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:07.455480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171c94-9005-42a5-a254-c952721bf34a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:07.456095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171c94-9005-42a5-a254-c952721bf34a None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:07.457053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e171c94-9005-42a5-a254-c952721bf34a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:07.458709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e171c94-9005-42a5-a254-c952721bf34a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:07.529633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:07.535756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 496/982] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:32:07 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:08.454452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c2a1-53d0-4fe6-a7c2-d3380ee7552d None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:08.454967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c2a1-53d0-4fe6-a7c2-d3380ee7552d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:08.455046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0c2a1-53d0-4fe6-a7c2-d3380ee7552d None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:08.456438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 487/983] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:08.461440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:08.461841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:08.462001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:08.480654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:08.481859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:08.562195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 497/984] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:08.584561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c2a1-53d0-4fe6-a7c2-d3380ee7552d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:08.600630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:08.700516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0c2a1-53d0-4fe6-a7c2-d3380ee7552d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:08.734598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:08.735405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:08.735691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:08.735989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:08.736647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:08.738009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:08.750993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:08.752270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:08.753168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 488/985] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:32:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:08.761256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:08.863908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734cdd4-4de5-4510-8f5e-69e53f372baf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:08.888563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:08.899391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:08.900132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:08.900419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:08.900766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:08.901779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:08.902087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:08.903460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:08.913150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 498/986] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:08.914510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:08.996307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:09.017679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b349246-cf5a-4198-965d-dd5b800e6933 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.052913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:09.053575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.053855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.054127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.054829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:09.055132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:09.056514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:09.061794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 489/987] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:09.067463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.168174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702bb56-f2d3-4318-891a-44103f27c8c4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.202576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:09.203225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.203501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.203769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.204590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] RBAC: Adding query filter params (interface=admin, service_id=e7c700cafc7a48eca64e30a243b68e08, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:09.204900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:09.206252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45170e2a-ee5c-4dc7-911a-fb3e7bd53585 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:09.211405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 499/988] 10.222.0.45 () {56 vars in 1249 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/endpoints?service_id=e7c700cafc7a48eca64e30a243b68e08&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:09.217475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.316589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114c1c0-ad38-4260-b2ef-ad4f69b91d23 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.349831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f25899-83a8-4732-b060-55ecc015cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:09.350490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25899-83a8-4732-b060-55ecc015cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.350770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25899-83a8-4732-b060-55ecc015cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.351044 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f25899-83a8-4732-b060-55ecc015cdb4 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.351715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25899-83a8-4732-b060-55ecc015cdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:09.353107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f25899-83a8-4732-b060-55ecc015cdb4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:09.367937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 490/989] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:32:09.421194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbf707-680d-4c88-bb38-67822b2bc538 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.421480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbf707-680d-4c88-bb38-67822b2bc538 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.421760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbf707-680d-4c88-bb38-67822b2bc538 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.423182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 500/990] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:09.429148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00d80-c9cf-4b62-ac01-536d1760f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.429441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00d80-c9cf-4b62-ac01-536d1760f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.429725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00d80-c9cf-4b62-ac01-536d1760f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.443547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:09.450352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b8b00d80-c9cf-4b62-ac01-536d1760f3d5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:09.451580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b8b00d80-c9cf-4b62-ac01-536d1760f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:09.528400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 491/991] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:09.550355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbf707-680d-4c88-bb38-67822b2bc538 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.570920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef679fc-52c7-43a8-af1c-1fc1a258fc2e None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.571221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef679fc-52c7-43a8-af1c-1fc1a258fc2e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.571411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef679fc-52c7-43a8-af1c-1fc1a258fc2e None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.573591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 492/992] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:09.578414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.578685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.578962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.597264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:09.598449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:09.610132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:09.665496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbf707-680d-4c88-bb38-67822b2bc538 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.671179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 493/993] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:09.694115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.707169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:09.707988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.708273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.708551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.709277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:09.710581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:09.722985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:09.724287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:09.725151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 501/994] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:09.731150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.770975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:09.806047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784903-f22b-4c17-9db6-b2d92a23da57 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.841051 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:09.841775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.841960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c470475-6976-41d8-a8b3-8c837949c692 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.842084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.842318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.842973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:09.844381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:09.856303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:09.857313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:09.858162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 494/995] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:09.861650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:09.863392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.879961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:09.880615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:09.880896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:09.881171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:09.881897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:09.882204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:09.883566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:09.894069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 502/996] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:09.894741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:09.970693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ecbc-a5c1-4ac8-82b9-eccc6fc5b538 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:09.998818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:10.002906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865bf9cd-9750-4ab1-bcc0-be71d8e3dd0a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:10.004611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:10.005286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:10.005568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:10.005849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:10.006555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:10.006864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:10.008267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:10.013699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 495/997] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:10.019370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:10.044668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:10.045338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:10.045736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:10.046014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:10.046835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:10.047142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:10.048730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:10.064191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 503/998] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:10.140260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc53180-2f0d-4618-8a79-6a985770295f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:10.176222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:10.176910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:10.177194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:10.177467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:10.178183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:10.178491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:10.180014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:10.191077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 496/999] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:10.192321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:10.244435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:10.299381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736b2b-a331-40f9-a42d-40f540761ad4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:10.333023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22508489-e3af-435a-a729-0123467b206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:10.333679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508489-e3af-435a-a729-0123467b206a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:10.333962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508489-e3af-435a-a729-0123467b206a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:10.334236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508489-e3af-435a-a729-0123467b206a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:10.335020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22508489-e3af-435a-a729-0123467b206a None admin] RBAC: Adding query filter params (interface=public, service_id=0e1efe2f983545ddaeb3dc4fbcda9f62, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:10.335334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22508489-e3af-435a-a729-0123467b206a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:10.336791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22508489-e3af-435a-a729-0123467b206a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:10.342183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 504/1000] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:32:10 2022] GET /identity/v3/endpoints?service_id=0e1efe2f983545ddaeb3dc4fbcda9f62&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:10.347985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:10.408726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:10.458579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b269b-83c7-41be-82ca-09977a19389b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:10.492888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89184e-825b-4d1e-ba6b-e45139dfe8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:10.493583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89184e-825b-4d1e-ba6b-e45139dfe8db None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:10.493865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89184e-825b-4d1e-ba6b-e45139dfe8db None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:10.494139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89184e-825b-4d1e-ba6b-e45139dfe8db None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:10.495517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89184e-825b-4d1e-ba6b-e45139dfe8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:10.497023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89184e-825b-4d1e-ba6b-e45139dfe8db None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:10.508164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 497/1001] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:32:10 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:32:11.392000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3b4b-c000-41f7-8063-dc25ff014f67 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:11.392521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3b4b-c000-41f7-8063-dc25ff014f67 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:11.392633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3b4b-c000-41f7-8063-dc25ff014f67 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:11.394056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 505/1002] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:11.399043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:11.399437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:11.399597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:11.418658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:11.419823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:11.486354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 498/1003] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:11.509212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3b4b-c000-41f7-8063-dc25ff014f67 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:11.615621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3b4b-c000-41f7-8063-dc25ff014f67 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:11.627901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:11.654211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:11.654934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:11.655220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:11.655492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:11.656162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:11.657527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:11.669802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:11.671046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 12:32:11.672126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:11.675014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 506/1004] 10.222.0.45 () {56 vars in 1126 bytes} [Mon Jul 25 12:32:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:11.681214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:11.737691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:11.788490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae306452-9ac7-4e90-9826-9b75d944ac3b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:11.823247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:11.823912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:11.824224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:11.824502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:11.825207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:11.825517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:11.826889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:11.831839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 499/1005] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:11.837433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:11.940096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a52fe-6e2b-4b48-b98a-c77dba71d1b9 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:11.974302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:11.974955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:11.975242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:11.975515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:11.976251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:11.976557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:11.978214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d447-3250-4784-b239-da664fcdd1d1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:11.988264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 507/1006] 10.222.0.45 () {56 vars in 1122 bytes} [Mon Jul 25 12:32:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:11.989757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:12.077205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e1729-bc68-41ce-b025-2f716786333f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.077747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e1729-bc68-41ce-b025-2f716786333f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.077894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e1729-bc68-41ce-b025-2f716786333f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.079825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 508/1007] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:12.084447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.084731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.085008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.096093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445d49b-c954-4f36-8938-2262cdbe11dc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:12.104404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:12.105592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:12.114982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:12.135174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7767e1d-7eca-46e1-810e-fdc15f35df6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:12.135808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767e1d-7eca-46e1-810e-fdc15f35df6d None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.136124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767e1d-7eca-46e1-810e-fdc15f35df6d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.136402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767e1d-7eca-46e1-810e-fdc15f35df6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.137009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:12.137184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7767e1d-7eca-46e1-810e-fdc15f35df6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:12.138513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7767e1d-7eca-46e1-810e-fdc15f35df6d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:12.175962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 509/1008] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:12.197658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:12.249930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 500/1009] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:32:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:12.319761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747a6b0-ef53-46a6-bb94-b2f1ad8867aa None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:12.363244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979d7d-6b57-4c81-b64e-a78d296a5c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:12.363911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979d7d-6b57-4c81-b64e-a78d296a5c75 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.364220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979d7d-6b57-4c81-b64e-a78d296a5c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.364492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979d7d-6b57-4c81-b64e-a78d296a5c75 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.365217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979d7d-6b57-4c81-b64e-a78d296a5c75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:12.366596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979d7d-6b57-4c81-b64e-a78d296a5c75 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:12.483196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 510/1010] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:32:12 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:12.548252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816bb4-7b9e-4408-b93f-e40a9adde376 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.548815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816bb4-7b9e-4408-b93f-e40a9adde376 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.548815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816bb4-7b9e-4408-b93f-e40a9adde376 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.550469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 501/1011] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:12.555889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.556210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.556520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.576499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:12.577735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:12.596507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:12.659228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 511/1012] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:12.686095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816bb4-7b9e-4408-b93f-e40a9adde376 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:12.790213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816bb4-7b9e-4408-b93f-e40a9adde376 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:12.824158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:12.824957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.825239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.825513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.826162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:12.827527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:12.839999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:12.841025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:12.842204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 502/1013] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:12.847969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:12.948773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdc9ad-5df6-4e6d-9be7-ef304e9535f2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:12.984335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:12.985006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:12.985289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:12.985560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:12.986261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:12.986565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:12.987945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:12.993269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 512/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:12.999036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:13.043129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:13.099403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b566-725f-4c2f-b155-a4a0a18a4eab None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:13.135504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:13.136196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:13.136483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:13.136759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:13.137463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:13.137797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:13.139149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afae09-75d9-44ed-9d74-2331f547feb7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:13.144356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 503/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Mon Jul 25 12:32:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:13.149808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:13.165141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:13.250989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb246-90c5-4df4-8c3c-e4484e926873 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:13.285532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b9215-8e8a-48d2-a09b-960b1932b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:13.286188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9215-8e8a-48d2-a09b-960b1932b027 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:13.286470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9215-8e8a-48d2-a09b-960b1932b027 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:13.286745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b9215-8e8a-48d2-a09b-960b1932b027 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:13.287491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9215-8e8a-48d2-a09b-960b1932b027 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:13.288871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b9215-8e8a-48d2-a09b-960b1932b027 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:13.412042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 513/1016] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:32:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:14.304482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8adb99-dc85-4473-a925-4d03592cae90 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.305009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8adb99-dc85-4473-a925-4d03592cae90 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.305009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8adb99-dc85-4473-a925-4d03592cae90 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.307026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 504/1017] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:14.312503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03859b8-5de1-4f0a-95f5-b5c3f6381949 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.312898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03859b8-5de1-4f0a-95f5-b5c3f6381949 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.313062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03859b8-5de1-4f0a-95f5-b5c3f6381949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.330998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f03859b8-5de1-4f0a-95f5-b5c3f6381949 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:14.332198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f03859b8-5de1-4f0a-95f5-b5c3f6381949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:14.394796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:14.406676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 514/1018] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:14.429968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8adb99-dc85-4473-a925-4d03592cae90 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:14.512080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec890086-cc54-4a4e-9b9c-cb4aa90c14ee None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.512431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec890086-cc54-4a4e-9b9c-cb4aa90c14ee None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.512641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec890086-cc54-4a4e-9b9c-cb4aa90c14ee None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.514135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 515/1019] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:14.519011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.519300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.519578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.537420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8adb99-dc85-4473-a925-4d03592cae90 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:14.537914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:14.539080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:14.540538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:14.575883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:14.576609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.576888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.577157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.578327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:14.579761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:14.581592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 505/1020] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:14.587028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:14.612176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 516/1021] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:14.634183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:14.702280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c460009-2e7e-4df7-aa33-61c49b859425 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:14.735834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:14.736518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.736797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.737072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.737776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:14.739197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:14.746456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0150bf-c5b5-4345-a1e6-0beae994a5f4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:14.770933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:14.782064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:14.782849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.783125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.783397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.784073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:14.785419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:14.796770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:14.798083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:14.799226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:14.802835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 517/1022] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Jul 25 12:32:14 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:14.803694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:14.810605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 506/1023] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:32:14 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:14.916861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce7e17-35e0-4bb1-978b-dbd3bd2949a2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:14.953502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:14.954216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:14.954459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:14.954738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:14.955452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:14.955764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:14.957176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:14.962423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 518/1024] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:14.969754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:14.999722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.079185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3dea0-b592-4e78-94c8-d1b015cbc690 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:15.113246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:15.113922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.114207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.114487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.115198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] RBAC: Adding query filter params (type=image) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:15.115507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:15.116907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:15.123211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 507/1025] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:15.129271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:15.186811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.235911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5adc3e-46a1-4e3a-afd5-d8e0223d5693 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:15.270295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:15.270954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.271238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.271531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.272335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] RBAC: Adding query filter params (interface=public, service_id=e28f5ea22ce041fdaca3f41049f4e591, region_id=RegionOne) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:15.272653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:15.274023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8755f-a33f-4d7f-9ad2-a48b0744f09a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:15.280420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 519/1026] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:32:15 2022] GET /identity/v3/endpoints?service_id=e28f5ea22ce041fdaca3f41049f4e591&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:15.285774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:15.377282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.390493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0c71-355e-44e8-a9fc-0d271d34769a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:15.424196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831bee65-1751-4f31-bacb-16656d6a2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:15.424871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bee65-1751-4f31-bacb-16656d6a2aac None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.425155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bee65-1751-4f31-bacb-16656d6a2aac None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.425432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831bee65-1751-4f31-bacb-16656d6a2aac None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.426114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bee65-1751-4f31-bacb-16656d6a2aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:15.427477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831bee65-1751-4f31-bacb-16656d6a2aac None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:15.440248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 508/1027] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:32:15 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:32:15.520555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66bd2-b5dd-420e-88ea-4db023e97edd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.521093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66bd2-b5dd-420e-88ea-4db023e97edd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.521093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df66bd2-b5dd-420e-88ea-4db023e97edd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.522647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 520/1028] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:15.528654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.528973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.529221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.548932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:15.550180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:15.622344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 509/1029] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:15.648889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66bd2-b5dd-420e-88ea-4db023e97edd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:15.761511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df66bd2-b5dd-420e-88ea-4db023e97edd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:15.779571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.797047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:15.797850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.798129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.798411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.809030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:15.817480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:15.818604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:15.819507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:15.827736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 521/1030] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Jul 25 12:32:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:15.828859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:15.909160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:15.927139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b192-5ec1-4881-82bc-fc509834cb67 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:15.962090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:15.963506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:15.963785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:15.964084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:15.964834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:15.965138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:15.966510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:15.980833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 510/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:32:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:15.981826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:16.084008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f9acb-f042-4c4b-8013-fe4f17220758 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:16.117563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:16.118348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.118625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.119433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.130011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:16.131441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:16.151055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:16.152227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:16.153173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:16.153173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:16.153173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:16.153173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:16.153173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 522/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:16.159217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:16.258805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cef9f-e4ae-4214-b60d-4cb22e938cd8 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:16.291622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:16.292301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.292584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.292857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.293576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:16.293880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:16.295241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:16.308528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 511/1033] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:16.314352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:16.342524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:16.414756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326864d-9052-4dbd-9fde-62ed8d7bba29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:16.448822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:16.449605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.449884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.450154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.457284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:16.458717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:32:16.473250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:16.474254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:32:16.475254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:16.476702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 523/1034] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:32:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:16.481059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:16.485153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:16.593481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c7804-cb74-4141-9e83-10d33266832f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:16.630273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:16.631277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.631752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.632234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.633248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:16.633734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:16.635896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c86377-57c9-4ae3-98fa-603c322f8186 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:16.660254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 512/1035] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:32:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:16.662031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:16.762525 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:16.775095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e577-54a8-49f0-98cc-dea214029e4f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:16.810874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:16.811515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.811793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.812096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.882139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:16.883659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:16.898045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2401c3-94d4-4b17-8a47-b672f38877af None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.898335 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2401c3-94d4-4b17-8a47-b672f38877af None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.898612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2401c3-94d4-4b17-8a47-b672f38877af None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.900060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 513/1036] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:16.905328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:16.905681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:16.905957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:16.924500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:16.925811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:16.980968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:16.995972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 524/1037] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 12:32:17.000980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:17.002006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.013745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 514/1038] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:17.039573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.113545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1f105-b0f9-4ebb-967d-2879d980a1c7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.182977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca7d35-f3c2-4cab-8bb5-d10094767c56 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.184032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.184833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.185112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.185384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.200080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.201656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.220859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.221658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.222021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.222502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] PATH_INFO: `/v3/domains/default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:17.223618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:17.224519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:17.225480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:17.225480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:17.225480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:17.225480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:17.225706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.226478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.231970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 515/1039] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:17.232178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 525/1040] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:17.232336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.234898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.286056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:17.299873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:17.346235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b7f22-099b-4ac2-aa22-e6ad30538ede None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.351061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89cfcb-56f1-4cf6-ad03-e9ee38ebcbc0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.388895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d779cd1-6f28-4460-a98a-660a36d0965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.389565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d779cd1-6f28-4460-a98a-660a36d0965d None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.389884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d779cd1-6f28-4460-a98a-660a36d0965d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.390115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d779cd1-6f28-4460-a98a-660a36d0965d None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.390504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.390825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d779cd1-6f28-4460-a98a-660a36d0965d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.391170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.391505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.392000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.392351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d779cd1-6f28-4460-a98a-660a36d0965d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.392736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:17.393048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.394417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.408568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 516/1041] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:17.414215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.507956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 526/1042] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:32:17 2022] POST /identity/v3/users => generated 285 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:17.533765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcd289-8bc3-4e54-a0b6-c2d69cf8978d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.557306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:17.572658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.573568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.573856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.574133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.581982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.583511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.593613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58162-a174-480d-b3ab-bc711ac044dd None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.593944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58162-a174-480d-b3ab-bc711ac044dd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.594174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e58162-a174-480d-b3ab-bc711ac044dd None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.595642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 527/1043] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:32:17.601079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:17.602206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:17.604206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:17.604790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.604790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.604790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.607437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 517/1044] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:17.612900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.623020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:17.624319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:17.713808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 528/1045] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:17.738123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.747799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149da3a-499c-414f-b4a5-e641605ca3fd None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.773843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:17.786038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.786715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.787000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.787277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.788085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:17.788398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.790278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.805155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 518/1046] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:17.812881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.855184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf8a8-1941-4e5f-bfb5-d64b58d94bd6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.859889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:17.893121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.894190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.894617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.895050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] PATH_INFO: `/v3/services/image` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.895840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.897377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:17.909765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:17.910852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:17.911733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 529/1047] 10.222.0.45 () {56 vars in 1105 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:17.917912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:17.925544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9a31d-00a4-4b01-a1d6-e6234e9cd09a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:17.961884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:17.962653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:17.962940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:17.963218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:17.964225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] RBAC: Adding query filter params (role.id=a5700d33578b4c708295af61b791a84e, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=62eba0e2bd914eeb949bb434f8a6cd9c) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:17.964545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:17.966071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:17.979956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 519/1048] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/role_assignments?user.id=62eba0e2bd914eeb949bb434f8a6cd9c&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=a5700d33578b4c708295af61b791a84e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:18.029134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:18.039644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e35e0-41c0-4f4a-81c1-ea141df6f48b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:18.079433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:18.080147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:18.080433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:18.080774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:18.081436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:18.081749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:18.083176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:18.095431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 530/1049] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:18.097184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:18.200632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053c05e-0e26-4ff2-932d-5d65012912f4 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:18.202928 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:18.234870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:18.235542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:18.235824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:18.236132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:18.236841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] RBAC: Adding query filter params (type=image) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:18.237147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:18.238512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15cbd0-35e8-4120-90f0-e8b0a261753b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:18.243763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 520/1050] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:18.249676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:18.350407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30015-2900-43ec-9de6-786a9759d8a8 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:18.384065 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152c5f4-030e-48f3-9f0c-9c6ef54427d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:18.385414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c5f4-030e-48f3-9f0c-9c6ef54427d0 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:18.385701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c5f4-030e-48f3-9f0c-9c6ef54427d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:18.385976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152c5f4-030e-48f3-9f0c-9c6ef54427d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:18.386717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c5f4-030e-48f3-9f0c-9c6ef54427d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:18.388108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152c5f4-030e-48f3-9f0c-9c6ef54427d0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:18.501161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 531/1051] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:32:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:19.624378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71205504-efa2-4cdc-aa9a-26f0c79155d4 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:19.624970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71205504-efa2-4cdc-aa9a-26f0c79155d4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:19.624970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71205504-efa2-4cdc-aa9a-26f0c79155d4 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:19.626477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 521/1052] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:19.632464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:19.633011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:19.633011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:19.652247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:19.653431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:19.656314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:19.729778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 532/1053] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:19.752722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71205504-efa2-4cdc-aa9a-26f0c79155d4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:19.858585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71205504-efa2-4cdc-aa9a-26f0c79155d4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:19.893200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4def58-806d-4b81-9a1b-dc267cc69b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:19.893913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4def58-806d-4b81-9a1b-dc267cc69b44 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:19.894198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4def58-806d-4b81-9a1b-dc267cc69b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:19.894469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4def58-806d-4b81-9a1b-dc267cc69b44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:19.905988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4def58-806d-4b81-9a1b-dc267cc69b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-fe4def58-806d-4b81-9a1b-dc267cc69b44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:19.913519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:19.914442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:19.915308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:19.920934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 522/1054] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:19.922155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.023444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80befbac-d129-415b-8258-7afce38f9e16 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.030978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f95c6-62fb-4149-8329-7701d8a907d1 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.031266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f95c6-62fb-4149-8329-7701d8a907d1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.031539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f95c6-62fb-4149-8329-7701d8a907d1 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.033082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 523/1055] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:20.037739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.038024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.038298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.057388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:20.058571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:20.060988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.061866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.062154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.062427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.063169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:20.063472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.065078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.067541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.079450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 533/1056] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:20.080520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.090594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.140969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 524/1057] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:20.158912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.192234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556c332-465a-4b1d-9940-d2db359f7203 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.230809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.232127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.232612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.233067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] PATH_INFO: `/v3/users/de2f7563d6f14ab1ab85015b27849fa1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.248366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] RBAC: Authorizing `identity:get_user(user_id=de2f7563d6f14ab1ab85015b27849fa1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.250214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.257012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 534/1058] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/users/de2f7563d6f14ab1ab85015b27849fa1 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:20.258164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.262331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b83e8-2f11-4a74-b11b-a3cd62cced60 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.295866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.296701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.296982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.297253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.308562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:20.316888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:20.317834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:20.318677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 525/1059] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:20.322750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.324978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.345706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.370389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec4596-5a24-457e-a25b-8295dab19fab None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.407764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380f306-5037-4225-a3c0-48d7b0ef7029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.408751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f306-5037-4225-a3c0-48d7b0ef7029 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.409308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f306-5037-4225-a3c0-48d7b0ef7029 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.409741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380f306-5037-4225-a3c0-48d7b0ef7029 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.426721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44d849-eaab-4175-a3df-ec4603ba273f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.460555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.461212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.461494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.461767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.463028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:20.463327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.464711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.472925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 526/1060] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:20.479157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.490144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380f306-5037-4225-a3c0-48d7b0ef7029 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.492782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380f306-5037-4225-a3c0-48d7b0ef7029 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.556606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.562722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.580927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde54cf-8e38-42a3-a536-b454c92ac61c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.600859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 535/1061] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:20.601996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfe994-6c78-470f-af53-923d03748080 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.602280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfe994-6c78-470f-af53-923d03748080 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.602559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfe994-6c78-470f-af53-923d03748080 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.604717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 536/1062] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:20.606954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfe994-6c78-470f-af53-923d03748080 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.614678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.615471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.615754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.616063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.627714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.629602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-68b094ed-6eca-4084-a04b-5f1a251976e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:20.646850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:20.647986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:20.649132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:20.649132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:20.649132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:20.649132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:20.652059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 527/1063] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:20.653483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.653773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.654057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.671360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:20.672507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:20.708541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfe994-6c78-470f-af53-923d03748080 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.739806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 528/1064] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:20.740716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.745822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.746676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.746960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.747233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.748441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b232e4a47d4fe1850436f20353e833)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.749876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.756664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 537/1065] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:20.757476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.782958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.807169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:20.845104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dffd8e-f05d-43a7-91d4-bc32addc37c9 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.859320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5988cb-f5af-48d1-b144-5691626a5653 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:20.878653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.879319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.879602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.879876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.880619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:20.880925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.882289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.893948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 529/1066] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:20.894741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:20.901596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f621-e59b-421d-81d5-278768644ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:20.902252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f621-e59b-421d-81d5-278768644ace None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:20.902535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f621-e59b-421d-81d5-278768644ace None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:20.902810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f621-e59b-421d-81d5-278768644ace None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:20.903639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f621-e59b-421d-81d5-278768644ace None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=b9b232e4a47d4fe1850436f20353e833, user.id=de2f7563d6f14ab1ab85015b27849fa1) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:20.903979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f621-e59b-421d-81d5-278768644ace None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:20.905424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f621-e59b-421d-81d5-278768644ace None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:20.911182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 538/1067] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/role_assignments?user.id=de2f7563d6f14ab1ab85015b27849fa1&scope.project.id=b9b232e4a47d4fe1850436f20353e833&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:20.911854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f621-e59b-421d-81d5-278768644ace None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.004743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cafd0e-439a-4cd4-9f11-1d988e74f7d2 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.028473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.029317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.042100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f621-e59b-421d-81d5-278768644ace None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.042615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.043284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.043565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.043840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.081965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.082755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.083050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.083329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.091562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.093128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:32:21.109219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:21.110421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:21.111392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 539/1068] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:21.116520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.122971 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.124527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.225287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fdcce-b190-48be-8795-acfaee988a72 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.236399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 530/1069] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:21.242377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.266752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.268141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.269000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.269285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.269746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.270595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:21.271078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.272360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.290920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 540/1070] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:21.296638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.305676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.349719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf337bd-5f89-43e6-868f-6ae200fd9bb1 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.390665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.391459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.391741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.392082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.403198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.404844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.405567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd543f2e-cb79-4990-a004-615c6be98fe0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:21.423186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:21.424370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:21.425314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:21.425314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:21.425314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:21.425314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:21.425314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 531/1071] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:21.430449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.446202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.448006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.448509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.448885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.460348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.461943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:21.481509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:21.482478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:21.488569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:21.488569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:21.488569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:21.488569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:21.488569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 541/1072] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:21.488569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.511530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.538711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a07f3-0583-4b8e-9af8-7bd28f9cf8a5 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.550011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.578777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.579719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.580036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.580318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.581035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:21.581349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.582744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.595549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8efd9-8bf2-4e7e-b68d-191f0df0dc3e None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.596021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 532/1073] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:21.639548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.640262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.640548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.640825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.641565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:21.641877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.643300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.657252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 542/1074] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:21.662890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.773606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983491-1664-4d91-a44a-b54b526e6b2f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.807810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.808575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.808866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.809146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.811096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.816819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.818270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:32:21.833211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:21.834382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:21.835519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 533/1075] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:21.842644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:21.949699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6a18c-6635-426a-803e-4ba0ab2ab35b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:21.966785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:21.983693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:21.984413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:21.984696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:21.984971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:21.985751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:21.986063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:21.987497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5381c-8afd-46a5-bd15-6317f39322d9 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:22.004967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 543/1076] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:22.006172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:22.106987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ec007-c754-44d2-b833-00bdd770e96f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:22.141082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6e696-1473-41bd-aa81-566c81bee847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:22.141958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6e696-1473-41bd-aa81-566c81bee847 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:22.142241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6e696-1473-41bd-aa81-566c81bee847 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:22.142518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6e696-1473-41bd-aa81-566c81bee847 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/62eba0e2bd914eeb949bb434f8a6cd9c/roles/a5700d33578b4c708295af61b791a84e` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:22.144733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6e696-1473-41bd-aa81-566c81bee847 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=62eba0e2bd914eeb949bb434f8a6cd9c, role_id=a5700d33578b4c708295af61b791a84e)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:22.146163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6e696-1473-41bd-aa81-566c81bee847 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:22.214023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 534/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:32:22 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/62eba0e2bd914eeb949bb434f8a6cd9c/roles/a5700d33578b4c708295af61b791a84e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:32:22.910049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745bc1-5b85-4b0d-afd4-4096a5c5b9d0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:22.910576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745bc1-5b85-4b0d-afd4-4096a5c5b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:22.910576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07745bc1-5b85-4b0d-afd4-4096a5c5b9d0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:22.911977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 544/1078] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:22.917399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:22.917827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:22.917950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:22.935713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:22.936907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:22.984898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:23.001382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 535/1079] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:23.023831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745bc1-5b85-4b0d-afd4-4096a5c5b9d0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:23.124686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07745bc1-5b85-4b0d-afd4-4096a5c5b9d0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:23.158569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:23.159349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:23.159627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:23.159898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:23.170061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:23.177700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:23.178799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:23.179824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:23.184194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 545/1080] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:23.185235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:23.281447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3b805-85d4-4964-b9d3-8b1cb714dd0a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:23.316538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:23.317209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:23.317490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:23.317764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:23.318508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:23.318814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:23.320208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:23.328849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 536/1081] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:23.334701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:23.374194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:23.432537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0cdb-4761-4bb2-87c3-57e528e8fb8a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:23.465258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:23.466110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:23.466388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:23.466659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] PATH_INFO: `/v3/users/de2f7563d6f14ab1ab85015b27849fa1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:23.467824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] RBAC: Authorizing `identity:get_user(user_id=de2f7563d6f14ab1ab85015b27849fa1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:23.469267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:23.470872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 546/1082] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:23 2022] GET /identity/v3/users/de2f7563d6f14ab1ab85015b27849fa1 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:23.476598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:23.522880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:23.576015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa2441-1bd0-4e13-b271-a7416f802dfc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:23.608560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b64e93-5f56-407b-b27f-14952e9c0b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:23.609419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b64e93-5f56-407b-b27f-14952e9c0b22 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:23.609703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b64e93-5f56-407b-b27f-14952e9c0b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:23.609978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b64e93-5f56-407b-b27f-14952e9c0b22 None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:23.611153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b64e93-5f56-407b-b27f-14952e9c0b22 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b232e4a47d4fe1850436f20353e833)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:23.612620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b64e93-5f56-407b-b27f-14952e9c0b22 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:23.614469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 537/1083] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:23 2022] GET /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:23.621223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:23.721492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaecdb-ff3a-40c1-8d48-a4a5b418179c None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:23.728731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:23.754526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65bda-f570-4f80-bff9-a4bb1900fdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:23.755401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65bda-f570-4f80-bff9-a4bb1900fdb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:23.755682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65bda-f570-4f80-bff9-a4bb1900fdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:23.755981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65bda-f570-4f80-bff9-a4bb1900fdb6 None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833/users/de2f7563d6f14ab1ab85015b27849fa1/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:23.757926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a65bda-f570-4f80-bff9-a4bb1900fdb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b232e4a47d4fe1850436f20353e833, user_id=de2f7563d6f14ab1ab85015b27849fa1, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:23.760005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a65bda-f570-4f80-bff9-a4bb1900fdb6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:23.836784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 547/1084] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:32:23 2022] PUT /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833/users/de2f7563d6f14ab1ab85015b27849fa1/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:32:24.198863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0888-16ce-467a-a2b8-16338be7348f None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:24.198863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0888-16ce-467a-a2b8-16338be7348f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:24.198863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d0888-16ce-467a-a2b8-16338be7348f None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:24.199596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 538/1085] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:24.204669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:24.205094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:24.205366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:24.223655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:24.224937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:24.290968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 548/1086] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:24.313732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0888-16ce-467a-a2b8-16338be7348f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:24.413267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d0888-16ce-467a-a2b8-16338be7348f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:24.426514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:24.446868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:24.447871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:24.448188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:24.448465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:24.459400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:24.468662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:24.469652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:24.470789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 539/1087] 10.222.0.45 () {56 vars in 1120 bytes} [Mon Jul 25 12:32:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:24.475752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:24.566654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:24.572779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef0ca3-f1bd-408f-accd-d2efb7cf9ef1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:24.606750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:24.607415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:24.607696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:24.607995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:24.608737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:24.609043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:24.610400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:24.618677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 549/1088] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:32:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:24.624360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:24.724744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94f2e-262e-47a9-8a89-3975f533d55c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:24.758363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:24.759828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:24.760149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:24.760426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:24.770145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:24.771577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:24.788941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:24.790049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:24.791580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:24.791580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:24.791580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:24.791580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:24.791580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 540/1089] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:24.795960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:24.895352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f86bb-bdc5-48ed-8bc8-c5d6072d992a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:24.930040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:24.931349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:24.931629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:24.931992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:24.932724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:24.933025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:24.934383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:24.945982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 550/1090] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:24.952341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:24.980300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:25.050062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd344b-48e1-432b-9654-74fd42584889 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:25.085511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:25.086408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.086689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.087492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.094524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:25.095973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:32:25.110695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:25.111626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:25.112805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 541/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Mon Jul 25 12:32:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:25.117937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:25.137411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:25.216645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6c8ff-ffa8-4b6a-a798-71eb098eadc1 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:25.249521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:25.250175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.250457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.250728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.251554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:25.251862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:25.253315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:25.270582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 551/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Mon Jul 25 12:32:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:25.277201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:25.359387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:25.374522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466fca9-05af-4cc9-ae72-883dc4d2fb09 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:25.409111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:25.409761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.410045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.410320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.476144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:25.477622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:25.558131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:25.573673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 542/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:25.579412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:25.655353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:25.677736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c972e-ebea-4684-b1d9-ac5790daec80 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:25.714284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:25.715075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.715355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.715627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.725312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:25.726750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-ea9256b2-db71-4eff-8483-1411b881a245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:25.745070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:25.746024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:25.747039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:32:25.747039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:25.747039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:32:25.747039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:25.747039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 552/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:25.751867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:25.835510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b035eec-4f4f-4086-b66b-72929e7e5e56 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.835719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b035eec-4f4f-4086-b66b-72929e7e5e56 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.836026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b035eec-4f4f-4086-b66b-72929e7e5e56 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.838062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 553/1095] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:32:25.843138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.843487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.843768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.848555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff7181-8d75-4259-88e6-71395600760a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:25.862842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:25.864048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:25.883185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:25.884456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:25.884739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:25.885010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:25.885718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:25.886021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:25.887372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:25.898402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 543/1096] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:25.904724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:25.935321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 554/1097] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:25.950714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:25.959146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.002286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632c638-797a-4d24-87f7-dc2a6e98ad2f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.017715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:26.035722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.036537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.036816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.037085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.043908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.045368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.058742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f71819-d548-4f33-b72d-d1f79a26afa5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:32:26.059551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:26.060553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:26.062039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 544/1098] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:26.066399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.095347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.096097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.096383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.096733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.106627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:26.114318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:26.115839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:26.116747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 555/1099] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:32:26.121990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.219005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c658fa5-3c9e-455c-b000-2f934098c1c9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.226086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:26.251933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339d498-9f8a-447c-b81b-61d7c689b659 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.252892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.253548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.253828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.254099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.254873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:26.255181 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.256653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.268637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 545/1100] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:26.273935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:26.274711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.286515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.287170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.287448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.287717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.291759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:26.291759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.291759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.299284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 556/1101] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:26.305069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.372853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe0be-587d-44ae-8616-0cd200d23763 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.402180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9e680-d043-450a-b338-cc0468819991 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.406293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b559af-1757-4376-b924-e9609673870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.406949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b559af-1757-4376-b924-e9609673870d None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.407230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b559af-1757-4376-b924-e9609673870d None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.407506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b559af-1757-4376-b924-e9609673870d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.408356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b559af-1757-4376-b924-e9609673870d None admin] RBAC: Adding query filter params (role.id=a5700d33578b4c708295af61b791a84e, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=62eba0e2bd914eeb949bb434f8a6cd9c) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:26.408671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b559af-1757-4376-b924-e9609673870d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.410510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b559af-1757-4376-b924-e9609673870d None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.417631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 546/1102] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/role_assignments?user.id=62eba0e2bd914eeb949bb434f8a6cd9c&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=a5700d33578b4c708295af61b791a84e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:26.436746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.437636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.437912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.438177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] PATH_INFO: `/v3/users/de2f7563d6f14ab1ab85015b27849fa1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.439447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] RBAC: Authorizing `identity:get_user(user_id=de2f7563d6f14ab1ab85015b27849fa1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.440940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.442656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 557/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/users/de2f7563d6f14ab1ab85015b27849fa1 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:26.449629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b559af-1757-4376-b924-e9609673870d None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.482009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:26.554207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b559af-1757-4376-b924-e9609673870d None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.590737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.591403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.591676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.592082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.660323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.661694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.693744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:26.766846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 547/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:26.772601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:26.824212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:26.878389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60fe00-4759-47fc-a015-b8cf9ed142bc None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:26.912595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ba4db-3828-47b0-928b-077b0936be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:26.913369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba4db-3828-47b0-928b-077b0936be1d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:26.913646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba4db-3828-47b0-928b-077b0936be1d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:26.913914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ba4db-3828-47b0-928b-077b0936be1d None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:26.915835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ba4db-3828-47b0-928b-077b0936be1d None admin] RBAC: Authorizing `identity:get_project(project_id=b9b232e4a47d4fe1850436f20353e833)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:26.917323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ba4db-3828-47b0-928b-077b0936be1d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:26.919015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 558/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:26.925175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:27.029068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f666-ccac-4a74-a95e-37b4ef36cbbe None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:27.058850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:27.064577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:27.065505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:27.065792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:27.078329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:27.078329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=b9b232e4a47d4fe1850436f20353e833, user.id=de2f7563d6f14ab1ab85015b27849fa1) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:27.078329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:27.078329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040880a1-accf-457b-b8c0-0e45ced028f2 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:27.078329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 548/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:26 2022] GET /identity/v3/role_assignments?user.id=de2f7563d6f14ab1ab85015b27849fa1&scope.project.id=b9b232e4a47d4fe1850436f20353e833&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:29.090003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67af49-4f8a-4bf0-83db-7bd0e9a3a488 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:29.090549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67af49-4f8a-4bf0-83db-7bd0e9a3a488 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:29.090549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67af49-4f8a-4bf0-83db-7bd0e9a3a488 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:29.091905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 559/1107] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:29.096995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:29.104784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:29.104784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:29.115380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:29.116576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:29.180755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 549/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:29.204804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67af49-4f8a-4bf0-83db-7bd0e9a3a488 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:29.311005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67af49-4f8a-4bf0-83db-7bd0e9a3a488 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:29.326593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:29.344180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb431c3-2d21-45c0-bebf-95745e3c98e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:29.344901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb431c3-2d21-45c0-bebf-95745e3c98e0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:29.345184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb431c3-2d21-45c0-bebf-95745e3c98e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:29.345457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb431c3-2d21-45c0-bebf-95745e3c98e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:29.346612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb431c3-2d21-45c0-bebf-95745e3c98e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:29.348075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb431c3-2d21-45c0-bebf-95745e3c98e0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:29.349675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 560/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:29.355652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:29.450009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f383e-35b3-4b0d-af28-beb468d2a583 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:29.471769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:29.481781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22095e-c115-4dad-b7f7-511947d4dc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:29.482432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22095e-c115-4dad-b7f7-511947d4dc5f None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:29.482710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22095e-c115-4dad-b7f7-511947d4dc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:29.484469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22095e-c115-4dad-b7f7-511947d4dc5f None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:29.484469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22095e-c115-4dad-b7f7-511947d4dc5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:29.485119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22095e-c115-4dad-b7f7-511947d4dc5f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:29.566800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 550/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:32:29 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:31.593052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5680d-5c93-487f-bdb8-b676d834a4b7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:31.593648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5680d-5c93-487f-bdb8-b676d834a4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:31.593648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5680d-5c93-487f-bdb8-b676d834a4b7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:31.594967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 561/1111] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:31.600152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f759-ab90-4011-9f75-070518016dea None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:31.600609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f759-ab90-4011-9f75-070518016dea None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:31.600708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4f759-ab90-4011-9f75-070518016dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:31.619240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-53b4f759-ab90-4011-9f75-070518016dea None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:31.620441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-53b4f759-ab90-4011-9f75-070518016dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:31.684359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 551/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:31.707285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5680d-5c93-487f-bdb8-b676d834a4b7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:31.805912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5680d-5c93-487f-bdb8-b676d834a4b7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:31.837998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:31.838833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:31.839115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:31.839386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] PATH_INFO: `/v3/roles/4348185648f74543ae092c82e26979ee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:31.840866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] RBAC: Authorizing `identity:get_role(role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:31.842227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:31.843629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 562/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:31 2022] GET /identity/v3/roles/4348185648f74543ae092c82e26979ee => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:31.849294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4f759-ab90-4011-9f75-070518016dea None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:31.945504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4f759-ab90-4011-9f75-070518016dea None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:31.955653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:31.978358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:31.979231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:31.979511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:31.979786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] PATH_INFO: `/v3/users/6af0d447e3a84205a0521f46b8b74dc5` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:31.993537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] RBAC: Authorizing `identity:get_user(user_id=6af0d447e3a84205a0521f46b8b74dc5)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:31.994973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:31.996943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 552/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:31 2022] GET /identity/v3/users/6af0d447e3a84205a0521f46b8b74dc5 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:32.003162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:32.059663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:32.104927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fbe616-5bf2-4b4b-be8c-e8cef8637c94 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:32.138609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:32.139253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:32.139535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:32.139806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:32.204273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:32.205716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:32.254981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:32.300802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 563/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:32.307319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:32.406065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092654f-75e9-46ed-8f37-269029fc32ec None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:32.439314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25044660-dae8-4dab-99cd-7ebf3a58499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:32.440197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044660-dae8-4dab-99cd-7ebf3a58499f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:32.440483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044660-dae8-4dab-99cd-7ebf3a58499f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:32.440760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044660-dae8-4dab-99cd-7ebf3a58499f None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:32.441934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25044660-dae8-4dab-99cd-7ebf3a58499f None admin] RBAC: Authorizing `identity:get_project(project_id=b9b232e4a47d4fe1850436f20353e833)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:32.443363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25044660-dae8-4dab-99cd-7ebf3a58499f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:32.445072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 553/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:32 2022] GET /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:32.451685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:32.547229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3a162-76b5-47ac-aad4-b0da2786a69d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:32.580469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:32.581104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:32.581386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:32.581661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:32.582475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] RBAC: Adding query filter params (role.id=4348185648f74543ae092c82e26979ee, scope.project.id=b9b232e4a47d4fe1850436f20353e833, user.id=6af0d447e3a84205a0521f46b8b74dc5) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:32.582788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:32.584229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834644d-1c31-4827-868c-6bc4c049a69d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:32.589716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 564/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:32 2022] GET /identity/v3/role_assignments?user.id=6af0d447e3a84205a0521f46b8b74dc5&scope.project.id=b9b232e4a47d4fe1850436f20353e833&role.id=4348185648f74543ae092c82e26979ee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:34.537759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbdd27-6846-4e39-bacb-e220815714ef None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:34.538318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbdd27-6846-4e39-bacb-e220815714ef None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:34.538318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbdd27-6846-4e39-bacb-e220815714ef None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:34.539711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 554/1118] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:34.544861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:34.545279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:34.545394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:34.563437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:34.564638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:34.575500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:34.628858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 565/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:34.651362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbdd27-6846-4e39-bacb-e220815714ef None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:34.686878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:34.752236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbdd27-6846-4e39-bacb-e220815714ef None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:34.785145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:34.785989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:34.786274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:34.786550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] PATH_INFO: `/v3/roles/4348185648f74543ae092c82e26979ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:34.788123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] RBAC: Authorizing `identity:get_role(role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:34.790059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:34.791416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 555/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:34 2022] GET /identity/v3/roles/4348185648f74543ae092c82e26979ee => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:34.797276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:34.892375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f04ac8-5f0d-4e2b-8383-592e22f68165 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:34.924629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:34.925476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:34.925753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:34.926024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] PATH_INFO: `/v3/users/6af0d447e3a84205a0521f46b8b74dc5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:34.927185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=6af0d447e3a84205a0521f46b8b74dc5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:34.928628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:34.930847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 566/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:34 2022] GET /identity/v3/users/6af0d447e3a84205a0521f46b8b74dc5 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:34.936457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:35.030975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcff81c-ff0c-429c-928d-bf7f5bcb2296 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:35.033194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:35.063978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07808fe9-ebb2-405a-bd46-189139caf172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:35.064755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808fe9-ebb2-405a-bd46-189139caf172 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:35.065033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808fe9-ebb2-405a-bd46-189139caf172 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:35.065303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07808fe9-ebb2-405a-bd46-189139caf172 None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:35.066460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07808fe9-ebb2-405a-bd46-189139caf172 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b232e4a47d4fe1850436f20353e833)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:35.067867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07808fe9-ebb2-405a-bd46-189139caf172 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:35.069541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 556/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:34 2022] GET /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:35.075630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:35.090699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:35.172016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec8149-5101-43bd-80b6-2e1aa4f3b0d6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:35.204103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df5a7d-5c2b-4261-bdc2-3df9b71f03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:35.204963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df5a7d-5c2b-4261-bdc2-3df9b71f03d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:35.205238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df5a7d-5c2b-4261-bdc2-3df9b71f03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:35.205506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df5a7d-5c2b-4261-bdc2-3df9b71f03d7 None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833/users/6af0d447e3a84205a0521f46b8b74dc5/roles/4348185648f74543ae092c82e26979ee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:35.207648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df5a7d-5c2b-4261-bdc2-3df9b71f03d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b9b232e4a47d4fe1850436f20353e833, user_id=6af0d447e3a84205a0521f46b8b74dc5, role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:35.209077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df5a7d-5c2b-4261-bdc2-3df9b71f03d7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:35.281138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 567/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:32:35 2022] PUT /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833/users/6af0d447e3a84205a0521f46b8b74dc5/roles/4348185648f74543ae092c82e26979ee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:32:37.249648 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372bdb-5472-4d4d-b9df-c91f92f42d85 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:37.250205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372bdb-5472-4d4d-b9df-c91f92f42d85 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:37.250205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372bdb-5472-4d4d-b9df-c91f92f42d85 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:37.251553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 557/1124] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:37.256754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:37.257145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:37.257299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:37.276664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:37.277823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:37.341310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 568/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:37.364861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372bdb-5472-4d4d-b9df-c91f92f42d85 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:37.463964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372bdb-5472-4d4d-b9df-c91f92f42d85 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:37.497533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:37.498371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:37.498649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:37.498921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] PATH_INFO: `/v3/roles/4348185648f74543ae092c82e26979ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:37.500442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] RBAC: Authorizing `identity:get_role(role_id=4348185648f74543ae092c82e26979ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:37.501792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:37.503129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 558/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:37 2022] GET /identity/v3/roles/4348185648f74543ae092c82e26979ee => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:37.509006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:37.512052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:37.606538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484379d-73f3-4404-a8a6-d781511009ed None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:37.638716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:37.639569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:37.639846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:37.640146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] PATH_INFO: `/v3/users/6af0d447e3a84205a0521f46b8b74dc5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:37.641309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] RBAC: Authorizing `identity:get_user(user_id=6af0d447e3a84205a0521f46b8b74dc5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:37.642757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:37.644399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 569/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:37 2022] GET /identity/v3/users/6af0d447e3a84205a0521f46b8b74dc5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:32:37.650683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:37.692329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:37.748233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efeb0b5-4c34-4b48-8f8a-6af12ba32ff3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:37.780276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:37.780850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:37.781129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:37.781396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:37.844774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:37.846202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:37.884644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:37.939545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 559/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:37.946016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:38.014471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:38.043367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de1c4f-ba5d-4487-b860-8c436fa597e7 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:38.076328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050b155-d0ee-47b5-826a-17dc05fefdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:38.077166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b155-d0ee-47b5-826a-17dc05fefdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:38.077449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b155-d0ee-47b5-826a-17dc05fefdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:38.077724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b155-d0ee-47b5-826a-17dc05fefdb1 None admin] PATH_INFO: `/v3/projects/b9b232e4a47d4fe1850436f20353e833` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:38.078889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050b155-d0ee-47b5-826a-17dc05fefdb1 None admin] RBAC: Authorizing `identity:get_project(project_id=b9b232e4a47d4fe1850436f20353e833)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:38.080345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050b155-d0ee-47b5-826a-17dc05fefdb1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:38.082009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 570/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:37 2022] GET /identity/v3/projects/b9b232e4a47d4fe1850436f20353e833 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:38.088136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:38.182760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cb88f-29fd-4602-8859-2f35a228c838 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:38.214662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:38.215298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:38.215575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:38.215843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:38.216685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] RBAC: Adding query filter params (role.id=4348185648f74543ae092c82e26979ee, scope.project.id=b9b232e4a47d4fe1850436f20353e833, user.id=6af0d447e3a84205a0521f46b8b74dc5) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:38.216991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:38.218392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434baf0-ef92-4186-9072-090104d6f92f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:38.223983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 560/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:38 2022] GET /identity/v3/role_assignments?user.id=6af0d447e3a84205a0521f46b8b74dc5&scope.project.id=b9b232e4a47d4fe1850436f20353e833&role.id=4348185648f74543ae092c82e26979ee => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:40.213313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a36c-32d2-4f37-bc0b-ba5554c066c7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:40.213850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a36c-32d2-4f37-bc0b-ba5554c066c7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:40.213850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a36c-32d2-4f37-bc0b-ba5554c066c7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:40.215235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 571/1131] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:40.220241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:40.220663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:40.220785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:40.228551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:40.238785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:40.241823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:40.303988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 561/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 12:32:40.327321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a36c-32d2-4f37-bc0b-ba5554c066c7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:40.424973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a36c-32d2-4f37-bc0b-ba5554c066c7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:40.457283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cc171-ddc9-47f2-82e0-3ef038cc685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:40.458047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cc171-ddc9-47f2-82e0-3ef038cc685a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:40.458327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cc171-ddc9-47f2-82e0-3ef038cc685a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:40.458598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cc171-ddc9-47f2-82e0-3ef038cc685a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:40.459743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cc171-ddc9-47f2-82e0-3ef038cc685a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:40.462212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cc171-ddc9-47f2-82e0-3ef038cc685a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:40.463854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 572/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:40.469637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:40.565020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd5b86-bfcc-4c6c-8d9d-f73b73b16c32 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:40.597788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85a790-7d8c-4ac4-b3f2-f0872c02944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:40.598439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a790-7d8c-4ac4-b3f2-f0872c02944a None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:40.598724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a790-7d8c-4ac4-b3f2-f0872c02944a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:40.599001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85a790-7d8c-4ac4-b3f2-f0872c02944a None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:40.599714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85a790-7d8c-4ac4-b3f2-f0872c02944a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:40.601172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85a790-7d8c-4ac4-b3f2-f0872c02944a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:40.605737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:40.682637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 562/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:32:40 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:42.707682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead047b2-370f-4310-804f-fb0459f42e9d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:42.708153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead047b2-370f-4310-804f-fb0459f42e9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:42.708258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead047b2-370f-4310-804f-fb0459f42e9d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:42.709616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 573/1135] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:42.714927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:42.715346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:42.715485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:42.733472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:42.734658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:42.799996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 563/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:42.824367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead047b2-370f-4310-804f-fb0459f42e9d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:42.835047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:42.924908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead047b2-370f-4310-804f-fb0459f42e9d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:42.957342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77794b8d-f443-477e-869d-6df773fd5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:42.958063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77794b8d-f443-477e-869d-6df773fd5edb None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:42.958345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77794b8d-f443-477e-869d-6df773fd5edb None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:42.958622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77794b8d-f443-477e-869d-6df773fd5edb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:42.959784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77794b8d-f443-477e-869d-6df773fd5edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:42.961839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77794b8d-f443-477e-869d-6df773fd5edb None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:42.963446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 574/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:42.969125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:43.063892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf7f-39e0-43b3-8fb1-1f05cb4a4bd8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:43.079610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:43.097114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a3f38-170a-4389-8bf0-7facfff813bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:43.097779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a3f38-170a-4389-8bf0-7facfff813bb None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:43.098065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a3f38-170a-4389-8bf0-7facfff813bb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:43.098343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a3f38-170a-4389-8bf0-7facfff813bb None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:43.099058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a3f38-170a-4389-8bf0-7facfff813bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:43.100526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a3f38-170a-4389-8bf0-7facfff813bb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:43.171673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 564/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:32:42 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:32:45.228077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fffc-2fe3-4cad-9599-03feb73e5271 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:45.228635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fffc-2fe3-4cad-9599-03feb73e5271 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:45.228635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fffc-2fe3-4cad-9599-03feb73e5271 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:45.229926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 575/1139] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:45.235128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:45.235527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:45.235677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:45.254254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:45.255418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:45.319282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 565/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:45.342479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fffc-2fe3-4cad-9599-03feb73e5271 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:45.418930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:45.441618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fffc-2fe3-4cad-9599-03feb73e5271 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:45.474809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:45.475588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:45.475866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:45.476797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:45.486529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:45.495108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:45.496331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:45.497605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 576/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:45.502325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:45.596469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90751fdc-2b0c-441d-b8c7-56e576318061 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:45.597929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:45.630375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:45.631032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:45.631312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:45.631583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:45.632426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:45.632735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:45.634087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:45.641854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 566/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:45.647741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:45.746042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404f9eb-03f7-4d1c-9f5f-84cfed0f04d2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:45.778219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:45.779079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:45.779358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:45.779632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] PATH_INFO: `/v3/users/46bd76afd6634f25ba9e4e0859c5bf26` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:45.782267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:45.793067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] RBAC: Authorizing `identity:get_user(user_id=46bd76afd6634f25ba9e4e0859c5bf26)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:45.794491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:45.796173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 577/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:45 2022] GET /identity/v3/users/46bd76afd6634f25ba9e4e0859c5bf26 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:45.801934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:45.902173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c108e81-dba8-49cc-ad9d-f03029d34819 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:45.934366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:45.935005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:45.935287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:45.935562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:45.965117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:46.000557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:46.001974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:46.096062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 567/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:46.102787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:46.200263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cca15-0185-43da-9611-3e3c0b5d9f41 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:46.232984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1940827-65a4-4cc4-85f9-b4c883096d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:46.233824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940827-65a4-4cc4-85f9-b4c883096d1e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:46.234099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940827-65a4-4cc4-85f9-b4c883096d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:46.234367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1940827-65a4-4cc4-85f9-b4c883096d1e None admin] PATH_INFO: `/v3/projects/7e85846433c64d81ae7fe6e63eb165ee` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:46.235536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940827-65a4-4cc4-85f9-b4c883096d1e None admin] RBAC: Authorizing `identity:get_project(project_id=7e85846433c64d81ae7fe6e63eb165ee)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:46.236987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1940827-65a4-4cc4-85f9-b4c883096d1e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:46.238650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 578/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:46 2022] GET /identity/v3/projects/7e85846433c64d81ae7fe6e63eb165ee => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:46.245013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:46.303531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:46.340062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7d91-ad00-475c-aaf6-2355ccaee99c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:46.372515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:46.373152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:46.373434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:46.373708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:46.374527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=7e85846433c64d81ae7fe6e63eb165ee, user.id=46bd76afd6634f25ba9e4e0859c5bf26) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:46.374839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:46.376282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81213b-8a49-49ea-9663-1e24299fba04 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:46.381489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 568/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:46 2022] GET /identity/v3/role_assignments?user.id=46bd76afd6634f25ba9e4e0859c5bf26&scope.project.id=7e85846433c64d81ae7fe6e63eb165ee&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:48.317491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d54579-c961-4ed2-9658-d202215de88b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:48.318048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d54579-c961-4ed2-9658-d202215de88b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:48.318048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d54579-c961-4ed2-9658-d202215de88b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:48.319396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 579/1147] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:48.324530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:48.324915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:48.325087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:48.343301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:48.344514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:48.409599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 569/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:48.430980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d54579-c961-4ed2-9658-d202215de88b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:48.490946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:48.529563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d54579-c961-4ed2-9658-d202215de88b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:48.561470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:48.562241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:48.562518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:48.562786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:48.573284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:48.580885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:48.581986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:48.583177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 580/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:48.588745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:48.644944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:48.684040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146edb0-46d1-430a-83c2-bfbb4140ac26 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:48.718249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:48.718906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:48.719189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:48.719463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:48.720232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:48.720541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:48.721897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:48.729822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 570/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:48.735671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:48.833363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc155a87-66dc-4d2c-ae94-90f903f709f2 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:48.854736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:48.865817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:48.867425 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:48.867785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:48.868719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] PATH_INFO: `/v3/users/46bd76afd6634f25ba9e4e0859c5bf26` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:48.869545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] RBAC: Authorizing `identity:get_user(user_id=46bd76afd6634f25ba9e4e0859c5bf26)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:48.870988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:48.872620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 581/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:48 2022] GET /identity/v3/users/46bd76afd6634f25ba9e4e0859c5bf26 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:48.878337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:48.974294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc984-c880-4b07-9b22-2e24ddc039e3 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:48.993757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:49.006946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2fac-fccd-4f1b-a9b7-7f11e080538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:49.008484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2fac-fccd-4f1b-a9b7-7f11e080538e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:49.008766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2fac-fccd-4f1b-a9b7-7f11e080538e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:49.009036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2fac-fccd-4f1b-a9b7-7f11e080538e None admin] PATH_INFO: `/v3/projects/7e85846433c64d81ae7fe6e63eb165ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:49.010206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe2fac-fccd-4f1b-a9b7-7f11e080538e None admin] RBAC: Authorizing `identity:get_project(project_id=7e85846433c64d81ae7fe6e63eb165ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:49.011636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe2fac-fccd-4f1b-a9b7-7f11e080538e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:49.013343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 571/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:48 2022] GET /identity/v3/projects/7e85846433c64d81ae7fe6e63eb165ee => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:49.019317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:49.116985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c98dd0-11a7-430d-b16f-e70f2dca9806 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:49.149687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bb608-1202-4504-80fc-0be22001915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:49.150554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb608-1202-4504-80fc-0be22001915a None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:49.150838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb608-1202-4504-80fc-0be22001915a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:49.151115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bb608-1202-4504-80fc-0be22001915a None admin] PATH_INFO: `/v3/projects/7e85846433c64d81ae7fe6e63eb165ee/users/46bd76afd6634f25ba9e4e0859c5bf26/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:49.153085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bb608-1202-4504-80fc-0be22001915a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e85846433c64d81ae7fe6e63eb165ee, user_id=46bd76afd6634f25ba9e4e0859c5bf26, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:49.154502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bb608-1202-4504-80fc-0be22001915a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:49.229198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 582/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:32:49 2022] PUT /identity/v3/projects/7e85846433c64d81ae7fe6e63eb165ee/users/46bd76afd6634f25ba9e4e0859c5bf26/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:32:51.174342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221259a-859f-4bcc-a942-3cddfd34ed96 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:51.174873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221259a-859f-4bcc-a942-3cddfd34ed96 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:51.174873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221259a-859f-4bcc-a942-3cddfd34ed96 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:51.176279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 572/1154] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:51.181377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:51.181758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:51.181945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:51.199526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:51.200736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:51.246113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:51.265846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 583/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:51.289571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221259a-859f-4bcc-a942-3cddfd34ed96 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:51.386979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221259a-859f-4bcc-a942-3cddfd34ed96 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:51.418905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:51.419678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:51.419977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:51.420252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:51.430501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:32:51.438016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:51.438953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:32:51.440215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 573/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:51.445740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:51.540248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba174a7-05f0-49aa-a6f6-2a85543f8300 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:51.573068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:51.573720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:51.574000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:51.574272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:51.575009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:51.575312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:51.576702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:51.584432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 584/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:51.591206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:51.638336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:51.686699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8ac6-6e3e-49d5-bc5f-f7958eeb6943 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:51.720286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:51.721146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:51.721424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:51.721693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] PATH_INFO: `/v3/users/46bd76afd6634f25ba9e4e0859c5bf26` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:51.722851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] RBAC: Authorizing `identity:get_user(user_id=46bd76afd6634f25ba9e4e0859c5bf26)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:51.724291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:51.726055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 574/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:32:51 2022] GET /identity/v3/users/46bd76afd6634f25ba9e4e0859c5bf26 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:51.731708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:51.775674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:51.829624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb3724-bbad-4af4-a01a-7568e651baf5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:51.861038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:51.861670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:51.861952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:51.862351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:51.926248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:51.927673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:51.967631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:52.022052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 585/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:52.028535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:52.124238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7649e-5bd1-46eb-93cc-36ba19d53d20 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:52.140323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:52.157476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0caee-ec44-47d6-8e6c-dbf93b938f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:52.158316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0caee-ec44-47d6-8e6c-dbf93b938f53 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:52.158598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0caee-ec44-47d6-8e6c-dbf93b938f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:52.158873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0caee-ec44-47d6-8e6c-dbf93b938f53 None admin] PATH_INFO: `/v3/projects/7e85846433c64d81ae7fe6e63eb165ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:52.160076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0caee-ec44-47d6-8e6c-dbf93b938f53 None admin] RBAC: Authorizing `identity:get_project(project_id=7e85846433c64d81ae7fe6e63eb165ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:52.161499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0caee-ec44-47d6-8e6c-dbf93b938f53 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:52.163274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 575/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:32:52 2022] GET /identity/v3/projects/7e85846433c64d81ae7fe6e63eb165ee => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:52.170377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:52.266011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc261676-0806-47f6-b263-7704ef4c3c35 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:52.299161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:52.299800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:52.300116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:52.300397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:52.301217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=7e85846433c64d81ae7fe6e63eb165ee, user.id=46bd76afd6634f25ba9e4e0859c5bf26) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:52.301564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:52.302988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c5b21-f371-44b0-aba7-9f4ab62b8d3e None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:52.308925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 586/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:32:52 2022] GET /identity/v3/role_assignments?user.id=46bd76afd6634f25ba9e4e0859c5bf26&scope.project.id=7e85846433c64d81ae7fe6e63eb165ee&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:54.316333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbd419-95f6-4db7-9410-d5427f923793 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:54.316867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbd419-95f6-4db7-9410-d5427f923793 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:54.316867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbd419-95f6-4db7-9410-d5427f923793 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:54.318246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 576/1162] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:54.323513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:54.323975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:54.324093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:54.337312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:54.342594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:54.343779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:54.409483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 587/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:54.431196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbd419-95f6-4db7-9410-d5427f923793 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:54.530122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbd419-95f6-4db7-9410-d5427f923793 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:54.563267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:54.563897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:54.564210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:54.564493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:54.614585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:54.629872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:54.631325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:54.727577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 577/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:32:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:32:54.733528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:54.836406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a3988-c72c-4e36-b486-c57657078d37 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:54.869546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:54.870270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:54.870545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:54.870813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:54.873419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:54.877616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:54.879037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-2fb46b3c-a707-4cef-a41c-14ac62eddaa7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:32:54.893840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:32:54.895196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:32:54.896478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 588/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:32:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:32:54.901773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:54.981620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:54.996759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef10c5-235c-4993-bf6f-b3536f5d9779 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:55.029360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:55.030006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:55.030287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:55.030560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:55.031265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:32:55.031568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:55.032951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d4e68-e585-4eb7-a19c-0a4ebf0b3800 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:55.040373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 578/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Mon Jul 25 12:32:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:57.041531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5ccc-a7ec-4f38-9eca-e01925ba8bed None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:57.042083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5ccc-a7ec-4f38-9eca-e01925ba8bed None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:57.042083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca5ccc-a7ec-4f38-9eca-e01925ba8bed None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:57.043431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 589/1167] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:57.048464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d25d-ada5-433d-ad77-15e1fc635215 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:57.048849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d25d-ada5-433d-ad77-15e1fc635215 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:57.049014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866d25d-ada5-433d-ad77-15e1fc635215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:57.066802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4866d25d-ada5-433d-ad77-15e1fc635215 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:57.067995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4866d25d-ada5-433d-ad77-15e1fc635215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:57.131970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 579/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:57.154580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5ccc-a7ec-4f38-9eca-e01925ba8bed None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:57.251784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca5ccc-a7ec-4f38-9eca-e01925ba8bed None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:57.283928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281e0df-e8de-48fc-b774-bebb218dc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:57.284579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e0df-e8de-48fc-b774-bebb218dc2fe None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:57.284857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e0df-e8de-48fc-b774-bebb218dc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:57.285128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281e0df-e8de-48fc-b774-bebb218dc2fe None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:57.285860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281e0df-e8de-48fc-b774-bebb218dc2fe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:57.287200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281e0df-e8de-48fc-b774-bebb218dc2fe None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:57.360448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 590/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Mon Jul 25 12:32:57 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:32:59.354148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c818807-1b23-49e1-98a6-a25b274e4403 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:59.354712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c818807-1b23-49e1-98a6-a25b274e4403 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:59.354712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c818807-1b23-49e1-98a6-a25b274e4403 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:59.356166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 580/1170] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:32:59.361188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:59.361565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:59.361738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:59.380311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:32:59.382067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:32:59.429782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:59.446163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 591/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:32:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:32:59.468469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c818807-1b23-49e1-98a6-a25b274e4403 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:59.545212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:32:59.566942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c818807-1b23-49e1-98a6-a25b274e4403 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:59.600674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703af6-d355-46b7-ab32-7e93f474b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:59.602107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703af6-d355-46b7-ab32-7e93f474b97c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:59.602463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703af6-d355-46b7-ab32-7e93f474b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:59.602743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703af6-d355-46b7-ab32-7e93f474b97c None admin] PATH_INFO: `/v3/domains/fe976415d47949149e0cc6f337c09f5d` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:59.612903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703af6-d355-46b7-ab32-7e93f474b97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe976415d47949149e0cc6f337c09f5d)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:59.614285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1703af6-d355-46b7-ab32-7e93f474b97c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:59.616875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 581/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Mon Jul 25 12:32:59 2022] GET /identity/v3/domains/fe976415d47949149e0cc6f337c09f5d => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:32:59.622707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:32:59.720269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc506-d909-481b-80ce-1d780015a3fb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:32:59.753571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bb0d5-e513-4f6d-83cb-47750ed9c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:32:59.754213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb0d5-e513-4f6d-83cb-47750ed9c418 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:32:59.754490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb0d5-e513-4f6d-83cb-47750ed9c418 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:32:59.754768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb0d5-e513-4f6d-83cb-47750ed9c418 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:32:59.755461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bb0d5-e513-4f6d-83cb-47750ed9c418 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:32:59.756982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bb0d5-e513-4f6d-83cb-47750ed9c418 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:32:59.840487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 592/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:32:59 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:33:01.851204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269bf6-6c5a-4b9b-b8b3-5a88b585fba8 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:01.851787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269bf6-6c5a-4b9b-b8b3-5a88b585fba8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:01.851787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed269bf6-6c5a-4b9b-b8b3-5a88b585fba8 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:01.853176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 582/1174] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:33:01.858429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:01.858863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:01.858986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:01.877562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:33:01.878736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:33:01.906904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:01.943496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 593/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:33:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:33:01.968275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed269bf6-6c5a-4b9b-b8b3-5a88b585fba8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:02.067235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed269bf6-6c5a-4b9b-b8b3-5a88b585fba8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:02.099153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397aa0e-0b97-4328-9fd3-787babc849ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:02.100538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397aa0e-0b97-4328-9fd3-787babc849ce None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:02.100887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397aa0e-0b97-4328-9fd3-787babc849ce None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:02.101181 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397aa0e-0b97-4328-9fd3-787babc849ce None admin] PATH_INFO: `/v3/domains/fe976415d47949149e0cc6f337c09f5d` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:02.102365 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397aa0e-0b97-4328-9fd3-787babc849ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=fe976415d47949149e0cc6f337c09f5d)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:02.103799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397aa0e-0b97-4328-9fd3-787babc849ce None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:02.105424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 583/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Mon Jul 25 12:33:01 2022] GET /identity/v3/domains/fe976415d47949149e0cc6f337c09f5d => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:02.111054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:02.207300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669095cc-233b-4e54-97c4-af14f94f8534 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:02.240107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cdccf-6f5a-4cf5-afcf-cf9997397fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:02.240841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cdccf-6f5a-4cf5-afcf-cf9997397fd0 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:02.241380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cdccf-6f5a-4cf5-afcf-cf9997397fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:02.241652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cdccf-6f5a-4cf5-afcf-cf9997397fd0 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:02.242343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cdccf-6f5a-4cf5-afcf-cf9997397fd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:02.243748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cdccf-6f5a-4cf5-afcf-cf9997397fd0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:02.319536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 594/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:33:02 2022] POST /identity/v3/users => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:33:04.356766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25959408-9a46-4aee-9fd1-5a6549e88462 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:04.357321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25959408-9a46-4aee-9fd1-5a6549e88462 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:04.357321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25959408-9a46-4aee-9fd1-5a6549e88462 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:04.358686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 584/1178] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:33:04.363731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:04.364215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:04.364312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:04.382693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:33:04.383886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:33:04.400459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:04.447846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 595/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:33:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:33:04.470431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25959408-9a46-4aee-9fd1-5a6549e88462 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:04.480673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:04.569750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25959408-9a46-4aee-9fd1-5a6549e88462 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:04.602430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:04.603206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:04.603491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:04.603764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:04.614022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:33:04.622603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:33:04.623707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:33:04.625005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 585/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:33:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:33:04.629849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:04.726995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a8935-4986-4b1d-b135-0da5147f826c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:04.761675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:04.762333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:04.762610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:04.762882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:04.763624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:33:04.763950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:04.765303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:04.773329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 596/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:33:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:04.779076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:04.842101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:04.876088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb476-3b9d-443f-b866-6820be4703ad None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:04.907833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:04.908705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:04.908982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:04.909248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] PATH_INFO: `/v3/users/631afa78bc0242f7a0168fcb3d07c2c3` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:04.922447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] RBAC: Authorizing `identity:get_user(user_id=631afa78bc0242f7a0168fcb3d07c2c3)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:04.923885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:04.925571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 586/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:33:04 2022] GET /identity/v3/users/631afa78bc0242f7a0168fcb3d07c2c3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:04.931885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:04.949972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:05.028537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56adb2-b3ae-4f30-9bc1-ea89dc2f30a0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:05.061321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:05.061945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:05.062225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:05.062497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:05.180197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:05.181559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:05.197552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:05.276677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 597/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:33:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:33:05.282633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:05.377541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f483e5-e0cb-4e02-a37b-408809498dde None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:05.400017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:05.410014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1f620-da53-4d7c-bccd-fd9fb4fca480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:05.411020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1f620-da53-4d7c-bccd-fd9fb4fca480 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:05.411172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1f620-da53-4d7c-bccd-fd9fb4fca480 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:05.411445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1f620-da53-4d7c-bccd-fd9fb4fca480 None admin] PATH_INFO: `/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:05.413274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1f620-da53-4d7c-bccd-fd9fb4fca480 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0fad990b754fe6920e3df20b5ae7f2)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:05.414693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1f620-da53-4d7c-bccd-fd9fb4fca480 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:05.416387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 587/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:33:05 2022] GET /identity/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:05.422387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:05.519075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2059ed-4645-4434-8d7c-c97b33a08931 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:05.534869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:05.552329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:05.553019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:05.553298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:05.553643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:05.554458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=1f0fad990b754fe6920e3df20b5ae7f2, user.id=631afa78bc0242f7a0168fcb3d07c2c3) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:33:05.554766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:05.556251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283e77a-ebbc-49a2-9325-98fb6a20ac41 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:05.561712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 598/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:33:05 2022] GET /identity/v3/role_assignments?user.id=631afa78bc0242f7a0168fcb3d07c2c3&scope.project.id=1f0fad990b754fe6920e3df20b5ae7f2&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:07.542183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae2b1-c4a3-4f48-a4d3-bd95eb24b7d1 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:07.542754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae2b1-c4a3-4f48-a4d3-bd95eb24b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:07.542754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ae2b1-c4a3-4f48-a4d3-bd95eb24b7d1 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:07.544129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 588/1186] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:33:07.549212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:07.549621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:07.549770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:07.567399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:33:07.568874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:33:07.633544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 599/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:33:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:33:07.655838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ae2b1-c4a3-4f48-a4d3-bd95eb24b7d1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:07.755714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ae2b1-c4a3-4f48-a4d3-bd95eb24b7d1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:07.789286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:07.790071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:07.790351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:07.790622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:07.800413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:33:07.808412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:33:07.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:33:07.810630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 589/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:33:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:33:07.815772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:07.912472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea9dcc-cc29-4a7a-af0d-bbb2b857b105 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:07.922696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:07.945475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:07.946129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:07.946414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:07.946690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:07.947503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:33:07.947814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:07.949203 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:07.957167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 600/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:07.963643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:08.014795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:08.060657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0efcf-82a2-4662-9d45-dbe140282d0b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:08.093505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223db49-8452-4817-a855-180418d429ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:08.094377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223db49-8452-4817-a855-180418d429ce None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:08.094658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223db49-8452-4817-a855-180418d429ce None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:08.094994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223db49-8452-4817-a855-180418d429ce None admin] PATH_INFO: `/v3/users/631afa78bc0242f7a0168fcb3d07c2c3` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:08.096180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223db49-8452-4817-a855-180418d429ce None admin] RBAC: Authorizing `identity:get_user(user_id=631afa78bc0242f7a0168fcb3d07c2c3)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:08.097623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223db49-8452-4817-a855-180418d429ce None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:08.099227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 590/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:33:07 2022] GET /identity/v3/users/631afa78bc0242f7a0168fcb3d07c2c3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:08.106359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:08.202391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d9d78-ff8f-4e4f-8a59-f48f8b6dbc11 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:08.234646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34889a2-b2ba-4d5f-81d7-c7b99c92942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:08.235484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34889a2-b2ba-4d5f-81d7-c7b99c92942a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:08.235763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34889a2-b2ba-4d5f-81d7-c7b99c92942a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:08.236062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34889a2-b2ba-4d5f-81d7-c7b99c92942a None admin] PATH_INFO: `/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:08.237224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34889a2-b2ba-4d5f-81d7-c7b99c92942a None admin] RBAC: Authorizing `identity:get_project(project_id=1f0fad990b754fe6920e3df20b5ae7f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:08.238631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34889a2-b2ba-4d5f-81d7-c7b99c92942a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:08.240859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 601/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:33:08 2022] GET /identity/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:08.247102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223db49-8452-4817-a855-180418d429ce None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:08.343988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223db49-8452-4817-a855-180418d429ce None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:08.362396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:08.376515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea8b05-d7ab-485a-84a4-02df5275a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:08.377387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea8b05-d7ab-485a-84a4-02df5275a202 None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:08.377670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea8b05-d7ab-485a-84a4-02df5275a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:08.377946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea8b05-d7ab-485a-84a4-02df5275a202 None admin] PATH_INFO: `/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2/users/631afa78bc0242f7a0168fcb3d07c2c3/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:08.379873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea8b05-d7ab-485a-84a4-02df5275a202 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f0fad990b754fe6920e3df20b5ae7f2, user_id=631afa78bc0242f7a0168fcb3d07c2c3, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:08.381884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea8b05-d7ab-485a-84a4-02df5275a202 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:08.445412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 591/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:33:08 2022] PUT /identity/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2/users/631afa78bc0242f7a0168fcb3d07c2c3/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:33:10.424983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2bda-89a7-4572-8616-a885bd7d7f3b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:10.425517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2bda-89a7-4572-8616-a885bd7d7f3b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:10.425517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2bda-89a7-4572-8616-a885bd7d7f3b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:10.426892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 602/1193] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:33:10.432145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:10.432617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:10.432716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:10.450781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:33:10.451995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:33:10.516484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 592/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:33:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:33:10.539151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2bda-89a7-4572-8616-a885bd7d7f3b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:10.581046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:10.638228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2bda-89a7-4572-8616-a885bd7d7f3b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:10.669873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:10.670636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:10.670932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:10.671200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:10.681504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:33:10.689079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:33:10.690219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:33:10.691654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 603/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:33:10.696947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:10.791057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de1437-bf88-4fc0-9d4b-4cc7c65df588 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:10.801214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:10.825234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:10.825893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:10.826194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:10.826451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:10.827193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:33:10.827502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:10.828929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:10.836751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 593/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:10.842432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:10.938362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:10.941168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efdc9-64dc-4c47-92c7-c8c8edb40dfd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:10.976421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:10.977281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:10.977561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:10.977834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] PATH_INFO: `/v3/users/631afa78bc0242f7a0168fcb3d07c2c3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:10.979002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] RBAC: Authorizing `identity:get_user(user_id=631afa78bc0242f7a0168fcb3d07c2c3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:10.980470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:10.982076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 604/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Mon Jul 25 12:33:10 2022] GET /identity/v3/users/631afa78bc0242f7a0168fcb3d07c2c3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:10.987888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:11.085825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e43449-8f83-407c-9251-85b07dbd67cc None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:11.120315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:11.120957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:11.121242 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:11.121517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:11.160650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:11.187063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:11.188948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:11.284692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 594/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:33:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:33:11.291062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:11.386500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a178d0-1b15-400c-8c8c-684f92cf1d0a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:11.419581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df424b5-69ae-4c41-bd29-c4c2cfb278c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:11.420440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df424b5-69ae-4c41-bd29-c4c2cfb278c5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:11.420722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df424b5-69ae-4c41-bd29-c4c2cfb278c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:11.420988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df424b5-69ae-4c41-bd29-c4c2cfb278c5 None admin] PATH_INFO: `/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:11.422152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df424b5-69ae-4c41-bd29-c4c2cfb278c5 None admin] RBAC: Authorizing `identity:get_project(project_id=1f0fad990b754fe6920e3df20b5ae7f2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:11.423560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df424b5-69ae-4c41-bd29-c4c2cfb278c5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:11.425240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 605/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Mon Jul 25 12:33:11 2022] GET /identity/v3/projects/1f0fad990b754fe6920e3df20b5ae7f2 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:11.431411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:33:11.498971 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:11.527398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e01e-a3f8-46bf-9958-834ea2df2c6a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:33:11.561169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:33:11.561803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:33:11.562080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:33:11.562347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:33:11.563161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=1f0fad990b754fe6920e3df20b5ae7f2, user.id=631afa78bc0242f7a0168fcb3d07c2c3) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:33:11.563468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:33:11.564923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42727461-8a27-48be-94e9-77483b8fc98c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:33:11.570507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 595/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:33:11 2022] GET /identity/v3/role_assignments?user.id=631afa78bc0242f7a0168fcb3d07c2c3&scope.project.id=1f0fad990b754fe6920e3df20b5ae7f2&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:33:21.415576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=82 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:33:21.568224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=32 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:21.677101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd31c9-b265-4b48-a7e2-d79355031366 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:21.677735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd31c9-b265-4b48-a7e2-d79355031366 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:21.677735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd31c9-b265-4b48-a7e2-d79355031366 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:21.679020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 606/1201] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:21.684265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:21.684727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:21.684838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:21.703603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:21.704834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:21.772041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 596/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:21.795407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd31c9-b265-4b48-a7e2-d79355031366 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:21.895090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd31c9-b265-4b48-a7e2-d79355031366 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:21.927692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:21.928447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:21.928725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:21.929002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:21.938889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:21.943989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:21.958163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:21.963838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:21.965174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:21.965174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:21.965174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:21.965174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:21.965174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 607/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:21.965566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:22.063575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fa139-779c-4d7a-8710-c2f2f74e06d0 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:22.091696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:22.097178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:22.098349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:22.098810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:22.099252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:22.099996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:22.100306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:22.101668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242d44-2fe5-4cd0-8e57-26eec2afef02 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:22.112467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 597/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:22.119276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:22.170919 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:22.217408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ed85-d90b-42c7-8af6-eaab215fdfce None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:22.250844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bbb15-f9bb-4a2c-b87b-b0cbfd508540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:22.251495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bbb15-f9bb-4a2c-b87b-b0cbfd508540 None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:22.251777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bbb15-f9bb-4a2c-b87b-b0cbfd508540 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:22.252092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bbb15-f9bb-4a2c-b87b-b0cbfd508540 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:22.252787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bbb15-f9bb-4a2c-b87b-b0cbfd508540 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:22.254240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bbb15-f9bb-4a2c-b87b-b0cbfd508540 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:22.333979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 608/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Mon Jul 25 12:34:22 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:34:24.400700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a7a67-2535-486b-a778-a9f383b88517 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:24.401254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a7a67-2535-486b-a778-a9f383b88517 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:24.401254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a7a67-2535-486b-a778-a9f383b88517 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:24.402670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 598/1206] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:24.408050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:24.408468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:24.408596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:24.427185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:24.428384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:24.494855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 609/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:24.517836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a7a67-2535-486b-a778-a9f383b88517 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:24.618204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a7a67-2535-486b-a778-a9f383b88517 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:24.650567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:24.651397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:24.651619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:24.651883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:24.662645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:34:24.671352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:24.672349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:24.673437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 599/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:24.677889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:24.718512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:24.776098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa2df1-0e20-43cc-82ff-bceae9f5fc71 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:24.810067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:24.810722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:24.811000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:24.811271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:24.812080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:24.812387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:24.813738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:24.822205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 610/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:24.828056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:24.877337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:24.925873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fb293-85a6-4c00-b705-9edf91bc216e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:24.959484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:24.960372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:24.960651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:24.960928 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:24.970967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:24.978703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:24.991870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:24.992889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:24.993891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:24.993891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:24.993891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:24.993891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:24.993891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 600/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:24.998883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:25.095874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:25.100247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a06ed-4b6f-402c-8833-6373b5091022 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:25.133397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:25.134045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:25.134316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:25.134586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:25.135290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:25.135589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:25.136987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:25.148707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 611/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:25.154392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:25.254416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cb6be-7b24-43db-aef3-46495ea994de None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:25.255978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:25.289524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:25.290312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:25.290592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:25.290860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:25.297923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:25.299377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:34:25.315058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:25.316115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:25.317544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 601/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:25.322228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:25.419984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fccfff-07d2-4b22-ad38-646fb6313d47 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:25.452269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:25.452923 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:25.453200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:25.453473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:25.454298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:25.454600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:25.456023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:25.473741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 612/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Jul 25 12:34:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:25.479506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:25.576766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb32e3c-c7f3-4b5c-a695-c36881415271 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:25.610047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:25.610684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:25.610963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:25.611236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:25.640009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:25.676233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:25.677665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:25.774461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 602/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:34:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:34:25.780304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:25.799422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:25.879047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca0bb7-3e77-433e-bf3f-fc93468247b4 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:25.911896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:25.912702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:25.912981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:25.913252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:25.922904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:25.924388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:25.942292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:25.943370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:25.944318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:25.944318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:25.944318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:25.944318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:25.944318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 613/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:25.949294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:26.009416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:26.045860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2254c5c-78dd-40c8-afd2-491bfc3acf5e None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:26.080183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:26.080942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:26.081234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:26.081515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:26.082442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:26.082825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:26.084261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:26.095699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 603/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:26.102585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:26.169363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:26.198138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb35dfc-5875-45a8-828f-09123c4d0ccd None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:26.231008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:26.231780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:26.232090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:26.232364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:26.238977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:26.240726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:34:26.254242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:26.255224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:26.256582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 614/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:26.261406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:26.360774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233c8d8-a7c4-4f43-b615-799d180f7851 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:26.382891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:26.394276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:26.395450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:26.395732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:26.396046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:26.396968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:26.397281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:26.398750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe8c3e-9267-4c81-9658-e2e244abedb0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:26.411088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 604/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:26.417381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:26.516656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749efcc-ff59-4f1f-8dd7-c908809a8001 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:26.545256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:26.552975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:26.553625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:26.553904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:26.554178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:26.554999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=d90a6d60fe644ab5a5c781b6348dfef5) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:26.555310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:26.556759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40653f-1f41-47e6-b588-528ac5ffc0ba None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:26.562136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 615/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:34:26 2022] GET /identity/v3/role_assignments?user.id=d90a6d60fe644ab5a5c781b6348dfef5&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:28.542327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e061-4ff4-44b1-b759-403eb576f353 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:28.542882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e061-4ff4-44b1-b759-403eb576f353 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:28.542882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e061-4ff4-44b1-b759-403eb576f353 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:28.544348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 605/1220] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:28.549686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:28.550120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:28.550224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:28.569482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:28.570654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:28.635140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 616/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:28.658277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e061-4ff4-44b1-b759-403eb576f353 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:28.761950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e061-4ff4-44b1-b759-403eb576f353 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:28.795100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:28.795704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:28.796009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:28.796285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:28.806698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:34:28.814577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:28.815699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:28.816824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 606/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:34:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:28.822048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:28.921583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ab86b-ea0c-48ef-b49f-dac9a1a3a13b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:28.944502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:28.954934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:28.955593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:28.955874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:28.956177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:28.957051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] RBAC: Adding query filter params (name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:28.957360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:28.958835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:28.966567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 617/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:34:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:34:28.973118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.016731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:29.072450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba20c99-cafc-4e8c-94f4-50412176b880 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:29.105249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:29.106054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:29.106327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:29.106600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:29.118270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:29.119732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:29.136752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:29.137822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:29.138889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:29.138889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:29.138889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:29.138889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:29.138889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 607/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:29.143727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.242422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fbb92-7d60-4e86-a0a1-4a4f4445011f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:29.275154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:29.275804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:29.276119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:29.276393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:29.277104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:29.277407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:29.278760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:29.290972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 618/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:29.296745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.389808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:29.397031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c74da-cb5c-4430-aea0-25ab4dda8165 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:29.430048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:29.430846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:29.431126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:29.431396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:29.438719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:29.440289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:34:29.454584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:29.455706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:29.457363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 608/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:29.462388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.510028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:29.561217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9eaa45-f251-4ad1-99b9-04e8505dddd6 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:29.595622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:29.596451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:29.596819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:29.597155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:29.598103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:29.598400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:29.599827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:29.617513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 619/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Jul 25 12:34:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:29.623340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.727270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1853-c0c2-43d4-9a02-cf2279795dbf None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:29.761806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:29.762598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:29.762882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:29.763157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:29.774323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:29.775787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:29.793132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:29.794213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:29.795482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:29.795482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:29.795482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:29.795482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:29.795482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 609/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:29.800253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.898180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe9500-e745-4bb3-acb2-c50b4687f58f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:29.900507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:29.931455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:29.932128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:29.932406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:29.932675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:29.933376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:29.933672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:29.935018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:29.946314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 620/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:29.951999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:29.961364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:30.049850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b5458-ab79-42e7-88ca-f049c5406e36 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:30.085672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:30.086457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:30.086738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:30.087008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:30.093462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:30.094904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:34:30.108705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:30.114824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:30.115931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 610/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:34:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:30.116908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:30.215213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feeee17-d4dc-46fa-9951-c19c2990214a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:30.247471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:30.248136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:30.248416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:30.248684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:30.249453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:30.249763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:30.251177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99bff5-6016-4fa5-978e-7dd31b511814 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:30.263199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 621/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:30.269517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:30.334086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:30.369199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e35379-e6f0-4cc6-8ea2-043efc20f5eb None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:30.402965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1f2b0-0cfd-4b3d-bc90-95bcd1e177fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:30.403853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1f2b0-0cfd-4b3d-bc90-95bcd1e177fb None admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:30.404159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1f2b0-0cfd-4b3d-bc90-95bcd1e177fb None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:30.404428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1f2b0-0cfd-4b3d-bc90-95bcd1e177fb None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/d90a6d60fe644ab5a5c781b6348dfef5/roles/71fb3dd8dbf54b24be7f2ce9bd264782` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:30.418610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1f2b0-0cfd-4b3d-bc90-95bcd1e177fb None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=d90a6d60fe644ab5a5c781b6348dfef5, role_id=71fb3dd8dbf54b24be7f2ce9bd264782)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:30.420059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1f2b0-0cfd-4b3d-bc90-95bcd1e177fb None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:30.487204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 611/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:34:30 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/d90a6d60fe644ab5a5c781b6348dfef5/roles/71fb3dd8dbf54b24be7f2ce9bd264782 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:34:32.442138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbc11-b5e7-488a-8da3-c42142f89edf None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:32.442751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbc11-b5e7-488a-8da3-c42142f89edf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:32.442751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddbc11-b5e7-488a-8da3-c42142f89edf None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:32.444102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 622/1233] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:32.449439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:32.449859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:32.449987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:32.468132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:32.469329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:32.534824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 612/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:32.557751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbc11-b5e7-488a-8da3-c42142f89edf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:32.583469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:32.659411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddbc11-b5e7-488a-8da3-c42142f89edf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:32.696512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:32.697330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:32.697613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:32.697890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:32.709112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:34:32.717003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:32.718195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:32.723292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 623/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Mon Jul 25 12:34:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:32.724467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:32.770417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:32.821729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab23394-ae4c-47e4-96f2-629fbb16ba2c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:32.857840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:32.858756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:32.859238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:32.859685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:32.860827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] RBAC: Adding query filter params (name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:32.861232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:32.862857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:32.873526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 613/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Mon Jul 25 12:34:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:32.880226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:32.963390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:32.979281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a0226-47a0-4c03-aa28-b088474b1047 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:33.011674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:33.012473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:33.012752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:33.013024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:33.023119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:33.024883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:33.043059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:33.044220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:33.045850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:33.045850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:33.045850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:33.045850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:33.045850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 624/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:33.049963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:33.150721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798075-5b6f-46a5-bde8-83496d6d4ede None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:33.159192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:33.183257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:33.183927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:33.184222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:33.184496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:33.185200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:33.185503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:33.186851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:33.198146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 614/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:33.203774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:33.302454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4835c-f47c-478a-bcc1-ffedaf26f5ac None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:33.336329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:33.337168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:33.337487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:33.337758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:33.340418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:33.344861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:33.346311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:34:33.361841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:33.362965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:33.364345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 625/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:33.369305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:33.469102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18909d25-e4bc-425c-8be9-6ef1485a1ba9 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:33.501505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:33.502164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:33.502442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:33.502711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:33.503526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:33.503832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:33.505824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:33.522746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 615/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Jul 25 12:34:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:33.528801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:33.627389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bb17-b3cd-4b66-b378-53204e01fefa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:33.661061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:33.661739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:33.662014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:33.662306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:33.723074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:33.729915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:33.731404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:33.835421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 626/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:34:33.837482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:33.864491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:33.933997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba7401-86b4-4559-bd34-63410af3837a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:33.971370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:33.972184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:33.972467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:33.972740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:33.983000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:33.984469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:34.002161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:34.003253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:34.004522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:34.004522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:34.004522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:34.004522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:34.004522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 616/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:34.009617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:34.104123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:34.109756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d28c0-472a-411e-9761-6248c34c9d5b None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:34.142804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:34.143459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:34.143742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:34.144117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:34.144829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:34.145243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:34.146630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:34.157638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 627/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:34.164248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:34.241228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:34.261606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e0e7e-dc53-43ff-9f39-5ec1847b44ad None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:34.293961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:34.294743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:34.295021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:34.295290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:34.302459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:34.307342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:34:34.317875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:34.318940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:34.320075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 617/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:34.325166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:34.424911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b10d4c-d635-4966-9633-5ddf8fa58c3f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:34.458653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:34.459301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:34.459582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:34.459863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:34.460672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:34.460998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:34.462410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff1456-0022-478d-a62a-2825f5e4e0f8 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:34.474941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 628/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:34.481240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:34.579270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387a90f-7015-408a-8883-4c50e37d5e02 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:34.612591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:34.613268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:34.613557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:34.613846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:34.615154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] RBAC: Adding query filter params (role.id=71fb3dd8dbf54b24be7f2ce9bd264782, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=d90a6d60fe644ab5a5c781b6348dfef5) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:34.615472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:34.617027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705b65d-5445-4c4c-aa5e-cf8475ca4a35 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:34.622919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 618/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:34:34 2022] GET /identity/v3/role_assignments?user.id=d90a6d60fe644ab5a5c781b6348dfef5&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=71fb3dd8dbf54b24be7f2ce9bd264782 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:36.690251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8933c-baa2-49ab-b109-071777220054 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:36.690745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8933c-baa2-49ab-b109-071777220054 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:36.690854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8933c-baa2-49ab-b109-071777220054 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:36.692397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 629/1247] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:36.697505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:36.697896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:36.698059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:36.704473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:36.716844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:36.718022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:36.788419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 619/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:36.811535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8933c-baa2-49ab-b109-071777220054 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:36.829753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:36.913997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8933c-baa2-49ab-b109-071777220054 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:36.947081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:36.947810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:36.948118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:36.948392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:36.958935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:34:36.966674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:36.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:36.968861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 630/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:36.974610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:37.073048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a8698-0221-4985-b97b-e9cfe410520d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:37.101082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:37.105758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:37.106416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:37.106695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:37.106963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:37.107694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:37.108025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:37.109391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:37.117448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 620/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:34:37.123089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:37.200000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:37.222246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d448d-18fa-4997-bb5f-59795cb10122 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:37.255854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:37.256681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:37.257058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:37.257332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:37.267459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:37.268970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:37.287104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:37.288230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:37.289532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:37.289532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:37.289532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:37.289532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:37.289532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 631/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:37.294052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:37.389763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1491d-d9f5-494a-b957-e559a9caab8b None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:37.422637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:37.423285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:37.423563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:37.423828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:37.424562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:37.424864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:37.426211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:37.437551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 621/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:34:37.443200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:37.542736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab7158-06d0-4b16-ada6-ec0d922b6910 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:37.568000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:37.575989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:37.576894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:37.577175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:37.577445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:37.585463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:37.588204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:34:37.601651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:37.602759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:37.603983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 632/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:37.610618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:37.665746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:37.709024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08978d91-3b67-4dec-b1da-761cbe5cc584 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:37.741879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:37.742658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:37.743139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:37.743587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:37.744914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:37.745225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:37.748156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:37.763862 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 622/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Jul 25 12:34:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:37.769680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:37.878096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3fb44-4174-4381-aef8-b59ec5c69377 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:37.913355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:37.914021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:37.914303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:37.914578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:37.969629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:37.981683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:37.983192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:38.078637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 633/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:34:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:34:38.085180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:38.185628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b240cb-c81e-4399-b2ac-5093b7c74cbe None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:38.199077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:38.219619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:38.222038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:38.222038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:38.222038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:38.230820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:38.232307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:38.251167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:38.252386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:38.253493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:38.253493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:38.253493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:38.253493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:38.253493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 623/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 12:34:38.258759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:38.345720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:38.357221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83f550-6f4d-4e3e-b5dc-659cf0bbf86a None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:38.390912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:38.391558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:38.391837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:38.392131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:38.392902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:38.393221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:38.394571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:38.410150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 634/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:38.411452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:38.511603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0ae6-b0a6-4013-9a6e-e0b9562eef0f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:38.546022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:38.546805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:38.547086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:38.547360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:38.554506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:38.555972 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:34:38.569659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:38.570822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:38.571913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 624/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:38.576735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:38.674291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9c1f-2674-468f-92d7-b02b9ce2b3aa None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:38.708066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:38.709265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:38.709540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:38.709806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:38.710574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:38.710879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:38.712320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad395bba-8a7d-4e63-add3-e3b30d096583 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:38.723811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 635/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:38.729990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:38.755933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:38.827682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b423f03-3e06-4d71-94df-5ff902dd57c0 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:38.860863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:38.861503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:38.861780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:38.862050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:38.862869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=d90a6d60fe644ab5a5c781b6348dfef5) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:38.863171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:38.865354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97e09-abf9-4cab-afe7-e9ad1122ac32 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:38.870605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 625/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:34:38 2022] GET /identity/v3/role_assignments?user.id=d90a6d60fe644ab5a5c781b6348dfef5&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:40.851096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44e940-843d-4c3a-ae26-5b12fe8e99c2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:40.851643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44e940-843d-4c3a-ae26-5b12fe8e99c2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:40.851643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44e940-843d-4c3a-ae26-5b12fe8e99c2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:40.853030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 636/1261] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:40.858092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:40.858470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:40.858639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:40.877334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:40.880962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:40.946095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 626/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:40.967783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44e940-843d-4c3a-ae26-5b12fe8e99c2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:40.979534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:41.068362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44e940-843d-4c3a-ae26-5b12fe8e99c2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:41.103515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:41.104324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:41.104602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:41.104871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:41.115514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:34:41.123344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:41.124456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:41.131396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 637/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:41.132281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:41.149292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:41.229436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259e91c-ab01-4634-bfb1-27f9d97d3e0d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:41.262427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:41.263716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:41.264030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:41.264371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:41.265122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:41.265428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:41.266794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:41.275532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 627/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:41.281567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:41.347494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:41.381125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ecc29-faf9-4c84-ae94-08848252e05d None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:41.415495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:41.416314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:41.416631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:41.416912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:41.427369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:41.428882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:41.446104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:41.447175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:41.448353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:41.448353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:41.448353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:41.448353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:41.448353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 638/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:41.453128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:41.533660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:41.551400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d470738-dbd7-44ed-bec7-f3a6b2622394 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:41.585410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:41.586099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:41.586389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:41.586668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:41.587389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:41.587730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:41.589471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:41.601507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 628/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:41.607157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:41.707021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66aac-9d3f-4d76-8357-b68aacad2413 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:41.727624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:41.741314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:41.742142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:41.742383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:41.742655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:41.750718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:41.752192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:34:41.766642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:41.767756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:41.769056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 639/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:41.774747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:41.872428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988b88b-245c-4cfb-9cd6-6f01994a2238 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:41.905825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:41.906534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:41.906809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:41.907076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:41.907939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:41.908246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:41.909653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:41.918117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:41.928937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 629/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Jul 25 12:34:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:41.935185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:42.034926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a6b60d-89c8-45e2-809d-c1bce8de0d17 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:42.069980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:42.070771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:42.071052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:42.071325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:42.082008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:42.083693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:42.101158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:42.106697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:42.107683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:42.107683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:42.107683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:42.107683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:42.107683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 640/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:42.108372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:42.210841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ffd9-7b69-4f9f-95cd-b72a5794ba2a None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:42.244701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:42.245358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:42.245636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:42.245906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:42.246615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:42.246916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:42.248294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:42.259954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 630/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:42.265688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:42.297585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:42.366490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b0093-cf64-4254-ab95-a5f89ecc25f0 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:42.401342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:42.402119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:42.402399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:42.402670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:42.409130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:42.410613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:34:42.424090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:42.425146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:42.426115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 641/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:42.431570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:42.490488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:42.531101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132757aa-a98d-421f-8148-5530f53047ed None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:42.562263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:42.562913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:42.563191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:42.563464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:42.564300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:42.564608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:42.566029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ed1fa-7101-4c6d-aadf-a023b3801c2b None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:42.577975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 631/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:34:42.584594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:42.681376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:42.689968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddf0b2-eec2-43fb-931a-33ed45ef3a29 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:42.723526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff25e31-97fb-4b04-901d-74ab1f33e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:42.724557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25e31-97fb-4b04-901d-74ab1f33e3c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:42.724837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25e31-97fb-4b04-901d-74ab1f33e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:42.725145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25e31-97fb-4b04-901d-74ab1f33e3c1 None admin] PATH_INFO: `/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/d90a6d60fe644ab5a5c781b6348dfef5/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:42.727102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff25e31-97fb-4b04-901d-74ab1f33e3c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f34ac92b2d654139b1300d7a276553f1, user_id=d90a6d60fe644ab5a5c781b6348dfef5, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:42.728553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff25e31-97fb-4b04-901d-74ab1f33e3c1 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:42.841368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 642/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Mon Jul 25 12:34:42 2022] PUT /identity/v3/projects/f34ac92b2d654139b1300d7a276553f1/users/d90a6d60fe644ab5a5c781b6348dfef5/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:34:44.823139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073c51-012e-4f48-91e9-fa5d41a67f0d None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:44.823683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073c51-012e-4f48-91e9-fa5d41a67f0d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:44.823683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073c51-012e-4f48-91e9-fa5d41a67f0d None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:44.825089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 632/1274] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:44.830430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:44.830862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:44.831014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:44.849411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:44.850620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:44.916931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 643/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:44.945704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073c51-012e-4f48-91e9-fa5d41a67f0d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.042782 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073c51-012e-4f48-91e9-fa5d41a67f0d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:45.060432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:45.076983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:45.077770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:45.078056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:45.078331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:45.088910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 12:34:45.096613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:45.097762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:45.099645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 633/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Mon Jul 25 12:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:45.104473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.184422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:45.201745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523983ce-895e-4869-9201-a180b3ccf206 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:45.235157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:45.235809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:45.236115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:45.236390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:45.237122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:45.237424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:45.239145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:45.247454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 644/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Mon Jul 25 12:34:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:45.253344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.353916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bbefc-6fbd-45ee-ade7-b6835eec445f None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:45.386320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:45.387101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:45.387382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:45.387689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:45.398491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:45.400006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:45.417562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:45.418683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:45.419809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:45.419809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:45.419809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:45.419809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:45.419809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 634/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:45.424750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.522811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf502-24cb-4afb-a426-8b4f5ac24fc5 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:45.555527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:45.556210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:45.556530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:45.556804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:45.557513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:45.557816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:45.559174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:45.570776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 645/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:45.576630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.607942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:45.675259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06be6d-1bc3-40b8-b03b-ca5617090133 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:45.709611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:45.710402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:45.710680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:45.710947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:45.718331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:45.719818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 12:34:45.734061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:45.739443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:45.740719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 635/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:45.741547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.745417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:45.839691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097bd81-8896-452e-b0b4-1e67c3620f28 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:45.872763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:45.873449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:45.873728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:45.873999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:45.874811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:45.875115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:45.876596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:45.894206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 646/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Mon Jul 25 12:34:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:45.901053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:45.990071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:45.999356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbc9b0-8825-4976-a84b-9c59e63964b7 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:46.032176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:46.032811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:46.033092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:46.033393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:46.099690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:46.101086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:46.186675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:46.197060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 636/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Mon Jul 25 12:34:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 12:34:46.203093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:46.264875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:46.302835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fdc1a-4ade-4528-8ac0-28caac9de07f None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:46.336509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:46.337289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:46.337603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:46.337871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:46.347375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:46.349826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 12:34:46.368094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:46.369206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:46.370340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 12:34:46.370340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 12:34:46.370340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 12:34:46.370340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:46.372079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 647/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:46.375197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:46.470581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b31dcf-f81f-4752-b948-053a1b84fd46 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:46.505160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:46.505814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:46.506093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:46.506363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:46.507079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:46.507384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:46.508765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:46.519601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 637/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Mon Jul 25 12:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:46.525679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:46.624138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e789-bcde-4bb1-bb07-342cbd24e021 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:46.638556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:46.657613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:46.658387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:46.658661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:46.658926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:46.665896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:46.667310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 12:34:46.682209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:46.683302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: ERROR keystone.server.flask.application Jul 25 12:34:46.684899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 648/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Mon Jul 25 12:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:46.689723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:46.740706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:46.789974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86507b66-6df5-4f04-bde8-f35fff9fd278 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:46.822594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:46.823243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:46.823524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:46.823807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:46.824612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:46.825047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:46.826477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44a50b-356b-413f-a5cc-88953db884dc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:46.838758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 638/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Mon Jul 25 12:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:46.845028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:46.945511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6dc4b-f0de-4a35-a81d-d5296e1a7f44 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:46.979413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:46.980090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:46.980386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:46.980663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:46.981490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] RBAC: Adding query filter params (role.id=add2d1a8e4c74bdda5ddb6a3e547e640, scope.project.id=f34ac92b2d654139b1300d7a276553f1, user.id=d90a6d60fe644ab5a5c781b6348dfef5) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:46.981805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:46.983260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4706d6-188f-49c5-b230-4e6cec21933f None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:46.989436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 649/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Mon Jul 25 12:34:46 2022] GET /identity/v3/role_assignments?user.id=d90a6d60fe644ab5a5c781b6348dfef5&scope.project.id=f34ac92b2d654139b1300d7a276553f1&role.id=add2d1a8e4c74bdda5ddb6a3e547e640 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:49.039726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9e0b0-35b6-452f-9582-38c0eb4ee6d2 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:49.040285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9e0b0-35b6-452f-9582-38c0eb4ee6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:49.040285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9e0b0-35b6-452f-9582-38c0eb4ee6d2 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:49.041723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 639/1288] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:49.046992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:49.047431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:49.047551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:49.065943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:49.067128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:49.096709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:49.135019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 650/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:49.156811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9e0b0-35b6-452f-9582-38c0eb4ee6d2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:49.259373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9e0b0-35b6-452f-9582-38c0eb4ee6d2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:49.269913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:49.292933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:49.293666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:49.293950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:49.294220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] PATH_INFO: `/v3/services/placement` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:49.294865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:49.296266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:49.308639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:49.313900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:49.314911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 640/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:34:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:49.315987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:49.414412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2ede1-ff77-4f7f-81c7-88246cfa3f61 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:49.448099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:49.448759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:49.449043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:49.449317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:49.450019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:49.450377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:49.451744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1d540-c864-4964-9c0d-2f2b20a8a457 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:49.456669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 651/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Jul 25 12:34:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:49.462550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:49.563164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d643d9d-e76e-48fa-8cd6-a9a46e2675da None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:49.595976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:49.596636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:49.596920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:49.597196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] PATH_INFO: `/v3/services` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:49.597896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] RBAC: Adding query filter params (type=placement) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:49.598204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:49.600092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dbb78-8c98-4177-8ed0-fc4b7f4095fc None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:49.604623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 641/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Jul 25 12:34:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:51.591448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceee1f-37dc-4a10-96da-eeb70cf4794f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:51.592032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceee1f-37dc-4a10-96da-eeb70cf4794f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:51.592032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ceee1f-37dc-4a10-96da-eeb70cf4794f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:51.593451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 652/1293] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:51.598452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1568-7de7-4292-86c0-667ec899827a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:51.598877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1568-7de7-4292-86c0-667ec899827a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:51.599007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a1568-7de7-4292-86c0-667ec899827a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:51.618356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ef8a1568-7de7-4292-86c0-667ec899827a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:51.619523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ef8a1568-7de7-4292-86c0-667ec899827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:51.648786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:51.686161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 642/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:51.707839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ceee1f-37dc-4a10-96da-eeb70cf4794f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:51.739208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:51.808135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ceee1f-37dc-4a10-96da-eeb70cf4794f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:51.840294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c618be-41a8-480b-9e84-a566e4a8998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:51.840949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c618be-41a8-480b-9e84-a566e4a8998d None admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:51.841232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c618be-41a8-480b-9e84-a566e4a8998d None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:51.841556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c618be-41a8-480b-9e84-a566e4a8998d None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:51.842233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c618be-41a8-480b-9e84-a566e4a8998d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:51.843588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c618be-41a8-480b-9e84-a566e4a8998d None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:51.915859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 653/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Mon Jul 25 12:34:51 2022] POST /identity/v3/services => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:34:53.910687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbbc6f-73f0-4ab3-88a8-c3af5fb408e2 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:53.911215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbbc6f-73f0-4ab3-88a8-c3af5fb408e2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:53.911215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbbc6f-73f0-4ab3-88a8-c3af5fb408e2 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:53.913388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 643/1296] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:53.918433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:53.918815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:53.918987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:53.937410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:53.938576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:54.009056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 654/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:54.031367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbbc6f-73f0-4ab3-88a8-c3af5fb408e2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:54.141479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbbc6f-73f0-4ab3-88a8-c3af5fb408e2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:54.174499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:54.175286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:54.175570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:54.175844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:54.176518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:54.178657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:54.190479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:54.191650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:54.192875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 644/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:34:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:54.198053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:54.216756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:54.295255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6edde6-2fb8-4857-b352-b7e91cf450f1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:54.328167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:54.328814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:54.329092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:54.329364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:54.330052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:54.330400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:54.331743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:54.337573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 655/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Jul 25 12:34:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:54.343578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:54.375491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:54.442669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face71e-1c51-45c6-a435-9e19197adc19 None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:54.476310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:54.476964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:54.477247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:54.477523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:54.478303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] RBAC: Adding query filter params (interface=public, service_id=17721160cd56456d8d0cc6b5fdc76b9a, region_id=RegionOne) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:54.478656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:54.480041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a77f90-9f83-4ce8-871f-ad72eecd4dd1 None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:54.485064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 645/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Mon Jul 25 12:34:54 2022] GET /identity/v3/endpoints?service_id=17721160cd56456d8d0cc6b5fdc76b9a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:54.491215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:54.571649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:54.590019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d545e-55dd-47b2-ab48-9426baf42f91 None admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:54.623282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82791240-c1cb-4676-a0db-05646e0ae282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:54.623943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791240-c1cb-4676-a0db-05646e0ae282 None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:54.624303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791240-c1cb-4676-a0db-05646e0ae282 None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:54.624617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82791240-c1cb-4676-a0db-05646e0ae282 None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:54.625285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82791240-c1cb-4676-a0db-05646e0ae282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:54.626637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82791240-c1cb-4676-a0db-05646e0ae282 None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:54.634017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 656/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Mon Jul 25 12:34:54 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:34:56.618007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b93908-1d80-4b2f-a2ee-177a739db14c None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:56.618545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b93908-1d80-4b2f-a2ee-177a739db14c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:56.618545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b93908-1d80-4b2f-a2ee-177a739db14c None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:56.619907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 646/1302] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:34:56.624988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:56.625416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:56.625547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:56.644040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:34:56.645336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:34:56.717018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 657/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:34:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 12:34:56.740661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b93908-1d80-4b2f-a2ee-177a739db14c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:56.835369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:56.841933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b93908-1d80-4b2f-a2ee-177a739db14c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:56.876236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:56.876958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:56.877256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:56.877510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:56.878148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:56.879499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 12:34:56.891213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 12:34:56.892454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application with Lock( Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self._enter() Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application return self.creator() Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application created_value = creator( Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: ERROR keystone.server.flask.application Jul 25 12:34:56.893532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 647/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Mon Jul 25 12:34:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 12:34:56.898468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:56.971709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:34:56.994803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c5327-e6e9-4c90-9b07-00ee0f88bcc4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:57.026910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:57.027597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:57.027876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:57.028282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] PATH_INFO: `/v3/services` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:57.028978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] RBAC: Adding query filter params (name=placement) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:34:57.029278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:57.030653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc6614-4c22-4f88-b00a-d150e4a423ab None admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:57.035598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 658/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Mon Jul 25 12:34:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:34:57.041988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:34:57.140188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953c994-286e-44d1-80e9-3555db057d2c None admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:34:57.172887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97718a37-cd41-4f8d-9de7-5e46e28ceb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:34:57.173537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97718a37-cd41-4f8d-9de7-5e46e28ceb6e None admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:34:57.173819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97718a37-cd41-4f8d-9de7-5e46e28ceb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:34:57.174093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97718a37-cd41-4f8d-9de7-5e46e28ceb6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:34:57.174835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97718a37-cd41-4f8d-9de7-5e46e28ceb6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:34:57.176269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97718a37-cd41-4f8d-9de7-5e46e28ceb6e None admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:34:57.263413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 648/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:34:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:35:07.032643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=30 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:35:07.258832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:46.495331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c602ac-eed5-41d5-b4df-8e4b3cf96156 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:46.496745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c602ac-eed5-41d5-b4df-8e4b3cf96156 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:46.497241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c602ac-eed5-41d5-b4df-8e4b3cf96156 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:46.505039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0164-cfa1-4914-a218-3e9a458ecc3b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:46.506272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0164-cfa1-4914-a218-3e9a458ecc3b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:46.506793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0164-cfa1-4914-a218-3e9a458ecc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:46.511517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 659/1307] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:40:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:40:46.600586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-077b0164-cfa1-4914-a218-3e9a458ecc3b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:40:46.602229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-077b0164-cfa1-4914-a218-3e9a458ecc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:46.748360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 649/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:40:46.789759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637da934-48ba-4ec8-95ab-5fb0b0890007 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:46.790222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637da934-48ba-4ec8-95ab-5fb0b0890007 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:46.790604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637da934-48ba-4ec8-95ab-5fb0b0890007 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:46.792118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 660/1309] 10.222.0.45 () {54 vars in 965 bytes} [Mon Jul 25 12:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:40:46.798505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9668cf6-3740-46f6-a40d-89806703b888 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:46.798832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9668cf6-3740-46f6-a40d-89806703b888 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:46.799069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9668cf6-3740-46f6-a40d-89806703b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:46.895512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e9668cf6-3740-46f6-a40d-89806703b888 None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:40:46.896802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e9668cf6-3740-46f6-a40d-89806703b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:46.925042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:47.078827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 650/1310] 10.222.0.45 () {58 vars in 1062 bytes} [Mon Jul 25 12:40:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:40:47.087956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637da934-48ba-4ec8-95ab-5fb0b0890007 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:40:47.090223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-637da934-48ba-4ec8-95ab-5fb0b0890007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:47.243965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637da934-48ba-4ec8-95ab-5fb0b0890007 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:40:47.325490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:40:47.326381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:47.326664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:47.326958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:47.328732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:47.385624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:47.442618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:40:47.444438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e21a27-a497-479f-9e6d-4a0490a2fd60 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:40:47.464209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 661/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:40:49.778314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38a772-d536-42fd-aacd-4614481d2ddc None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:49.778839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38a772-d536-42fd-aacd-4614481d2ddc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:49.778926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38a772-d536-42fd-aacd-4614481d2ddc None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:49.780426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 651/1312] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:40:49.785410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe37025-c70a-4e05-8897-9a411f36f908 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:49.786402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe37025-c70a-4e05-8897-9a411f36f908 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:49.786562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe37025-c70a-4e05-8897-9a411f36f908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:49.858394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0fe37025-c70a-4e05-8897-9a411f36f908 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:40:49.858604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0fe37025-c70a-4e05-8897-9a411f36f908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:49.967899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 662/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:40:50.008176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38a772-d536-42fd-aacd-4614481d2ddc None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:40:50.009712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ed38a772-d536-42fd-aacd-4614481d2ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:50.122002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38a772-d536-42fd-aacd-4614481d2ddc None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:40:50.202124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:50.205206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:40:50.205872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:50.206213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:50.206494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:50.208232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:50.323090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:40:50.324574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b618f-f551-493f-98eb-9323817f7fef service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:40:50.342858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 652/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:40:52.839559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7743-7e4f-4d98-ad72-26d04eeaac86 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:52.840221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7743-7e4f-4d98-ad72-26d04eeaac86 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:52.840221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7743-7e4f-4d98-ad72-26d04eeaac86 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:52.841531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 663/1315] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:40:52.846531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5ac6-7005-4829-a03b-a1db7c91a8a1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:52.846911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5ac6-7005-4829-a03b-a1db7c91a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:52.847083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe5ac6-7005-4829-a03b-a1db7c91a8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:52.911519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-99fe5ac6-7005-4829-a03b-a1db7c91a8a1 None None] MFA Rules not processed for user `18b68b87d49d46599bc930bb6a4763db`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:40:52.912758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-99fe5ac6-7005-4829-a03b-a1db7c91a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:52.963731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:53.009668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 653/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:40:53.050208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7743-7e4f-4d98-ad72-26d04eeaac86 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:40:53.051795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-df6a7743-7e4f-4d98-ad72-26d04eeaac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:53.061421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:53.153937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7743-7e4f-4d98-ad72-26d04eeaac86 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:40:53.224292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:40:53.224858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:53.225141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:53.225412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:53.227033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:53.286986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:53.331830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:40:53.334204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f8d69-294b-4a57-8b03-88e492bf5aaf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:40:53.353381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 664/1317] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:40:56.178415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e19ef-2641-4728-87e2-291002aee594 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:56.178979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e19ef-2641-4728-87e2-291002aee594 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:56.178979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e19ef-2641-4728-87e2-291002aee594 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:56.180395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 654/1318] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:40:56.185486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7ec7-6f07-474f-911b-d4c692538047 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:56.185891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7ec7-6f07-474f-911b-d4c692538047 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:56.186049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a7ec7-6f07-474f-911b-d4c692538047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:56.250649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5a0a7ec7-6f07-474f-911b-d4c692538047 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:40:56.251867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5a0a7ec7-6f07-474f-911b-d4c692538047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:56.347493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 665/1319] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:40:56.386465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e19ef-2641-4728-87e2-291002aee594 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:40:56.388087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4d6e19ef-2641-4728-87e2-291002aee594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:56.488132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e19ef-2641-4728-87e2-291002aee594 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:40:56.560534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:40:56.561197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:56.561482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:56.561760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:56.563427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:56.571569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:56.672165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:40:56.673600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce03d9-5184-4ed4-bbf9-0921c6e683e4 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:40:56.693255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 655/1320] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:40:59.762133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f071-a162-4f10-b730-5d6a6090110d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:59.762927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f071-a162-4f10-b730-5d6a6090110d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:59.762927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f071-a162-4f10-b730-5d6a6090110d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:59.764071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 666/1321] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:40:59.769509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732ac9-faca-4c58-9881-5cead927337f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:40:59.769943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732ac9-faca-4c58-9881-5cead927337f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:40:59.770364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732ac9-faca-4c58-9881-5cead927337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:40:59.835517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-77732ac9-faca-4c58-9881-5cead927337f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:40:59.836749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-77732ac9-faca-4c58-9881-5cead927337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:40:59.898226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:40:59.942129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 656/1322] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:40:59.979593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f071-a162-4f10-b730-5d6a6090110d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:40:59.981258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ef17f071-a162-4f10-b730-5d6a6090110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:00.001889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:00.090728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f071-a162-4f10-b730-5d6a6090110d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:00.165081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:00.165731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:00.166005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:00.166272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:00.167967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:00.238891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:00.279234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:00.280708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31418a6-b137-4c44-89a4-4952aa656eb0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:00.299060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 667/1323] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:02.373466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e623e8-15a9-49ca-a990-cb7cf41df68d None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:02.374000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e623e8-15a9-49ca-a990-cb7cf41df68d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:02.374000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e623e8-15a9-49ca-a990-cb7cf41df68d None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:02.375424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 657/1324] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:02.381451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea90b1-c085-4d35-9d97-bfbf0ee2a3e3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:02.381859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea90b1-c085-4d35-9d97-bfbf0ee2a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:02.382005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea90b1-c085-4d35-9d97-bfbf0ee2a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:02.451029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7dea90b1-c085-4d35-9d97-bfbf0ee2a3e3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:02.452161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7dea90b1-c085-4d35-9d97-bfbf0ee2a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:02.549844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 668/1325] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:02.586476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e623e8-15a9-49ca-a990-cb7cf41df68d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:02.588043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-44e623e8-15a9-49ca-a990-cb7cf41df68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:02.693579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e623e8-15a9-49ca-a990-cb7cf41df68d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:02.767020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:02.767669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:02.767981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:02.768292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:02.770508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:02.788126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:02.882863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:02.884378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8433-5d0c-4712-96dd-0bb26048d6d4 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:02.903487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 658/1326] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:04.962782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb978-a304-4cdc-9124-88408e1b0a8d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:04.963311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb978-a304-4cdc-9124-88408e1b0a8d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:04.963311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb978-a304-4cdc-9124-88408e1b0a8d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:04.964692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 669/1327] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:04.970515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b757-c81e-4f45-9cc1-d725144adabd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:04.971081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b757-c81e-4f45-9cc1-d725144adabd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:04.971081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b757-c81e-4f45-9cc1-d725144adabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:05.039029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5128b757-c81e-4f45-9cc1-d725144adabd None None] MFA Rules not processed for user `18b68b87d49d46599bc930bb6a4763db`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:05.040279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5128b757-c81e-4f45-9cc1-d725144adabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:05.104155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:05.136758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 659/1328] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:05.176123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb978-a304-4cdc-9124-88408e1b0a8d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:05.177819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-150bb978-a304-4cdc-9124-88408e1b0a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:05.209738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:05.288816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb978-a304-4cdc-9124-88408e1b0a8d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:05.361114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:05.361796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:05.362077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:05.362352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:05.364219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:05.440749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:05.472766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:05.474351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd11586-cbf8-4378-a7b9-28832cbe3be4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:05.494809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 670/1329] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:07.949587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a10506-dc1b-45d0-8ac0-fac089e27cef None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:07.950096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a10506-dc1b-45d0-8ac0-fac089e27cef None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:07.950096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a10506-dc1b-45d0-8ac0-fac089e27cef None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:07.951453 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 660/1330] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:07.957104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a737db3-08b0-4f4d-8e8f-08a556a1c3c2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:07.957582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a737db3-08b0-4f4d-8e8f-08a556a1c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:07.958062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a737db3-08b0-4f4d-8e8f-08a556a1c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:08.024164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6a737db3-08b0-4f4d-8e8f-08a556a1c3c2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:08.025371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6a737db3-08b0-4f4d-8e8f-08a556a1c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:08.121137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 671/1331] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:08.157806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a10506-dc1b-45d0-8ac0-fac089e27cef None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:08.159331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-80a10506-dc1b-45d0-8ac0-fac089e27cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:08.260693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a10506-dc1b-45d0-8ac0-fac089e27cef None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:08.342130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:08.342786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:08.343066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:08.343340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:08.345062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:08.373861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:08.461406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:08.462841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c0c9-dd9f-463b-9e93-20deb4e742c7 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:08.480805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 661/1332] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:10.532758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0e49-d8ab-44d5-9d96-39e11984cc3c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:10.533291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0e49-d8ab-44d5-9d96-39e11984cc3c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:10.533291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0e49-d8ab-44d5-9d96-39e11984cc3c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:10.534749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 672/1333] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:10.539809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0893b1-a255-4a90-8b1b-f0bfb03cf193 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:10.540270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0893b1-a255-4a90-8b1b-f0bfb03cf193 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:10.540415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0893b1-a255-4a90-8b1b-f0bfb03cf193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:10.607610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9c0893b1-a255-4a90-8b1b-f0bfb03cf193 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:10.608856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9c0893b1-a255-4a90-8b1b-f0bfb03cf193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:10.681497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:10.703984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 662/1334] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:10.745059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0e49-d8ab-44d5-9d96-39e11984cc3c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:10.746893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fdfb0e49-d8ab-44d5-9d96-39e11984cc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:10.786225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:10.847686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0e49-d8ab-44d5-9d96-39e11984cc3c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:10.918198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:10.918834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:10.919116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:10.919387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:10.921049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:11.005733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:11.032025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:11.033471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918172d0-b321-4b28-9fd9-45ff4f4a3711 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:11.052416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 673/1335] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:13.577356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a3e25-2264-4fe6-841c-fb2040f32534 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:13.577904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a3e25-2264-4fe6-841c-fb2040f32534 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:13.577904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a3e25-2264-4fe6-841c-fb2040f32534 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:13.579297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 663/1336] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:13.585173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0129-d074-4cbf-bad9-fbb311d9ad7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:13.585651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0129-d074-4cbf-bad9-fbb311d9ad7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:13.585752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e0129-d074-4cbf-bad9-fbb311d9ad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:13.651634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-998e0129-d074-4cbf-bad9-fbb311d9ad7a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:13.652907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-998e0129-d074-4cbf-bad9-fbb311d9ad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:13.751622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 674/1337] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:13.787851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a3e25-2264-4fe6-841c-fb2040f32534 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:13.789396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-040a3e25-2264-4fe6-841c-fb2040f32534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:13.890098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a3e25-2264-4fe6-841c-fb2040f32534 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:13.960779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:13.961421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:13.961696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:13.961966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:13.963571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:13.997943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:14.071105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:14.072573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7171a-27f0-4bca-a19e-a899dc02ff2c service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:14.090545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 664/1338] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:18.245024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c90ff-6ddc-443c-9965-0cfd7cfe5696 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:18.245464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c90ff-6ddc-443c-9965-0cfd7cfe5696 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:18.245836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c90ff-6ddc-443c-9965-0cfd7cfe5696 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:18.247202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 675/1339] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:18.253346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae596b8-6701-4f61-913d-a5f4c8b2b272 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:18.253827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae596b8-6701-4f61-913d-a5f4c8b2b272 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:18.253929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae596b8-6701-4f61-913d-a5f4c8b2b272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:18.323135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-dae596b8-6701-4f61-913d-a5f4c8b2b272 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:18.324505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-dae596b8-6701-4f61-913d-a5f4c8b2b272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:18.418563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:18.430014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 665/1340] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:18.469888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c90ff-6ddc-443c-9965-0cfd7cfe5696 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:18.472891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-921c90ff-6ddc-443c-9965-0cfd7cfe5696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:18.523763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:18.580125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c90ff-6ddc-443c-9965-0cfd7cfe5696 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:18.658489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:18.659167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:18.659459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:18.659729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:18.661407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:18.758891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:18.776211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:18.777768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7492f31-99a8-49d1-aeea-38576f54e2af service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:18.796281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 676/1341] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:21.811963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfe3b-1b27-4f72-a446-52caa64ee8cd None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:21.812494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfe3b-1b27-4f72-a446-52caa64ee8cd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:21.812494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bfe3b-1b27-4f72-a446-52caa64ee8cd None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:21.813891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 666/1342] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:41:21.819549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd33d-de06-4331-87c9-89021b18bff7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:21.819991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd33d-de06-4331-87c9-89021b18bff7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:21.820136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbd33d-de06-4331-87c9-89021b18bff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:21.885362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4ccbd33d-de06-4331-87c9-89021b18bff7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:21.886444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4ccbd33d-de06-4331-87c9-89021b18bff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:21.980470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 677/1343] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:22.018090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfe3b-1b27-4f72-a446-52caa64ee8cd None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:22.019652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-cc2bfe3b-1b27-4f72-a446-52caa64ee8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:22.125474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bfe3b-1b27-4f72-a446-52caa64ee8cd None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:22.198416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:22.198972 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:22.199251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:22.199523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:22.201192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:22.245183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:22.318838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:22.320297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d00782-234d-4f16-87fe-f53328d46ee8 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:22.339658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 667/1344] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:26.686164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19284-0049-44af-bf00-8048f4008d5e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:26.686164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19284-0049-44af-bf00-8048f4008d5e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:26.686164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19284-0049-44af-bf00-8048f4008d5e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:26.686164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 678/1345] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:26.686901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b53-af8f-49aa-b052-014bb22a0004 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:26.686901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b53-af8f-49aa-b052-014bb22a0004 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:26.686901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b2b53-af8f-49aa-b052-014bb22a0004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:26.758285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c93b2b53-af8f-49aa-b052-014bb22a0004 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:26.763399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c93b2b53-af8f-49aa-b052-014bb22a0004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:26.859503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:26.862324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 668/1346] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:26.902167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19284-0049-44af-bf00-8048f4008d5e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:26.903781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-57c19284-0049-44af-bf00-8048f4008d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:26.966655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:27.015088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19284-0049-44af-bf00-8048f4008d5e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:27.092507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:27.093160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:27.093445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:27.093726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:27.095382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:27.202177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:27.206234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:27.207773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2e55-dff1-433d-ade1-8bc1a972d089 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:27.226024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 679/1347] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:32.181623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce33f-422b-4676-865f-da4f7616399f None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:32.183588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce33f-422b-4676-865f-da4f7616399f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:32.184333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ce33f-422b-4676-865f-da4f7616399f None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:32.187455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 669/1348] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:41:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:32.194107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a719-b298-41ad-bacc-e4b4afebffc5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:32.194607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a719-b298-41ad-bacc-e4b4afebffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:32.194722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a719-b298-41ad-bacc-e4b4afebffc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:32.300571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3922a719-b298-41ad-bacc-e4b4afebffc5 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:32.302257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3922a719-b298-41ad-bacc-e4b4afebffc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:32.427744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 680/1349] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:41:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:36.522374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ea4e-7e26-4bb0-a9e1-236468d61192 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:36.523278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ea4e-7e26-4bb0-a9e1-236468d61192 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:36.523562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0ea4e-7e26-4bb0-a9e1-236468d61192 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:36.525174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 670/1350] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:36.531323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093974-1cd1-4420-821e-1a333ce1a523 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:36.531741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093974-1cd1-4420-821e-1a333ce1a523 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:36.531964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093974-1cd1-4420-821e-1a333ce1a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:36.592961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:36.618873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0a093974-1cd1-4420-821e-1a333ce1a523 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:36.620255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0a093974-1cd1-4420-821e-1a333ce1a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:36.753866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 681/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:38.076431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090d01-e23b-4773-9ae9-9c8e9416ec67 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:38.077012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090d01-e23b-4773-9ae9-9c8e9416ec67 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:38.077012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3090d01-e23b-4773-9ae9-9c8e9416ec67 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:38.078361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 671/1352] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:38.084247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4729-9c94-47fe-b9e9-40b73a9eda43 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:38.085034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4729-9c94-47fe-b9e9-40b73a9eda43 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:38.085316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4729-9c94-47fe-b9e9-40b73a9eda43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:38.164726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c76f4729-9c94-47fe-b9e9-40b73a9eda43 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:38.165937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c76f4729-9c94-47fe-b9e9-40b73a9eda43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:38.209540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:38.276328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 682/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:41.698106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63eb8-3c3d-4975-a5bd-91e069ae23da None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:41.698929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63eb8-3c3d-4975-a5bd-91e069ae23da None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:41.699366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f63eb8-3c3d-4975-a5bd-91e069ae23da None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:41.703748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 672/1354] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:41.707129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30cf9b-46c2-497d-8706-e837e94429cd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:41.707898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30cf9b-46c2-497d-8706-e837e94429cd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:41.708364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30cf9b-46c2-497d-8706-e837e94429cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:41.791590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1f30cf9b-46c2-497d-8706-e837e94429cd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:41.793015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f30cf9b-46c2-497d-8706-e837e94429cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:41.908082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 683/1355] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:41.962813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb5d5-b819-4649-b1b3-632266db5c14 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:41.963641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb5d5-b819-4649-b1b3-632266db5c14 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:41.964114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bb5d5-b819-4649-b1b3-632266db5c14 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:41.965678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 673/1356] 10.222.0.45 () {54 vars in 962 bytes} [Mon Jul 25 12:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:41.974115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4744b10-7b2f-4e1d-b382-26527f900e40 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:41.974516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4744b10-7b2f-4e1d-b382-26527f900e40 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:41.974913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4744b10-7b2f-4e1d-b382-26527f900e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:41.997464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:42.062698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e4744b10-7b2f-4e1d-b382-26527f900e40 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:42.063908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e4744b10-7b2f-4e1d-b382-26527f900e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:42.183904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 684/1357] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Jul 25 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:42.192937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bb5d5-b819-4649-b1b3-632266db5c14 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:42.194539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bc2bb5d5-b819-4649-b1b3-632266db5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:42.351480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bb5d5-b819-4649-b1b3-632266db5c14 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:42.432171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:42.476303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:42.477007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:42.477811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:42.477811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:42.479393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:42.577769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:42.579371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7aa3d-7fb3-4b8d-a480-0348b1fa1668 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:42.599066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 674/1358] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:44.880693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510013-4346-40be-b7f9-dbe8dd9dd198 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:44.881247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510013-4346-40be-b7f9-dbe8dd9dd198 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:44.881247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e510013-4346-40be-b7f9-dbe8dd9dd198 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:44.882725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 685/1359] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:44.888177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375f7d-efb9-493d-a00b-392ff6fe0275 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:44.888659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375f7d-efb9-493d-a00b-392ff6fe0275 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:44.889008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375f7d-efb9-493d-a00b-392ff6fe0275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:44.959266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2e375f7d-efb9-493d-a00b-392ff6fe0275 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:44.960673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2e375f7d-efb9-493d-a00b-392ff6fe0275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:45.000285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:45.074754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 675/1360] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:45.119328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510013-4346-40be-b7f9-dbe8dd9dd198 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:45.121553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0e510013-4346-40be-b7f9-dbe8dd9dd198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:45.203340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:45.290335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e510013-4346-40be-b7f9-dbe8dd9dd198 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:45.419363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:45.420041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:45.420323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:45.420599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:45.422244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:45.447977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:45.518873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:45.520703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e78484-88d0-4e49-868f-417242af6b5e service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:45.540412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 686/1361] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:48.095958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4927732-eeb3-4618-a78e-cbce38f8fb18 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:48.095958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4927732-eeb3-4618-a78e-cbce38f8fb18 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:48.095958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4927732-eeb3-4618-a78e-cbce38f8fb18 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:48.097074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 676/1362] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:48.102193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f926d-603a-4f25-91c0-19bbe5ee65fa None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:48.105900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f926d-603a-4f25-91c0-19bbe5ee65fa None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:48.105900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f926d-603a-4f25-91c0-19bbe5ee65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:48.173654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2f1f926d-603a-4f25-91c0-19bbe5ee65fa None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:48.175189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2f1f926d-603a-4f25-91c0-19bbe5ee65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:48.282538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:48.294688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 687/1363] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:48.338050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcca89-90d6-4b24-9b6b-5f47d7969402 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:48.338505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcca89-90d6-4b24-9b6b-5f47d7969402 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:48.338872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcca89-90d6-4b24-9b6b-5f47d7969402 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:48.340542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 677/1364] 10.222.0.45 () {54 vars in 962 bytes} [Mon Jul 25 12:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:48.346593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5a97-7f35-42e8-95d1-5aa2e4a931e0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:48.346861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5a97-7f35-42e8-95d1-5aa2e4a931e0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:48.347102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd5a97-7f35-42e8-95d1-5aa2e4a931e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:48.426025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-febd5a97-7f35-42e8-95d1-5aa2e4a931e0 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:48.427234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-febd5a97-7f35-42e8-95d1-5aa2e4a931e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:48.573840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 688/1365] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Jul 25 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:48.583159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcca89-90d6-4b24-9b6b-5f47d7969402 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:48.584914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-32bcca89-90d6-4b24-9b6b-5f47d7969402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:48.759875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcca89-90d6-4b24-9b6b-5f47d7969402 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:48.781450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:48.885596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:48.886253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:48.886521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:48.886795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:48.888445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:48.984428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:48.988003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8d697-905d-4e12-b462-160a1bed0d76 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:49.011766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 678/1366] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:49.931464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0fd29-3302-452b-9eaf-6f781705049f None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:49.932238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0fd29-3302-452b-9eaf-6f781705049f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:49.932238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0fd29-3302-452b-9eaf-6f781705049f None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:49.936077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 689/1367] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:49.940254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4e26-2c5d-4570-bfb5-f74991f55eae None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:49.940738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4e26-2c5d-4570-bfb5-f74991f55eae None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:49.940852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e4e26-2c5d-4570-bfb5-f74991f55eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:49.974137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:50.011177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-647e4e26-2c5d-4570-bfb5-f74991f55eae None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:50.012430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-647e4e26-2c5d-4570-bfb5-f74991f55eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:50.115958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 679/1368] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:50.484554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519be7-f60b-47d7-bf13-34f60c9ef72e None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:50.485040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519be7-f60b-47d7-bf13-34f60c9ef72e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:50.485474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519be7-f60b-47d7-bf13-34f60c9ef72e None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:50.487536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 690/1369] 10.222.0.45 () {54 vars in 964 bytes} [Mon Jul 25 12:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:50.492933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773baabd-429b-4b82-b815-734d9e04fc51 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:50.493231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773baabd-429b-4b82-b815-734d9e04fc51 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:50.493654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773baabd-429b-4b82-b815-734d9e04fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:50.585504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-773baabd-429b-4b82-b815-734d9e04fc51 None None] MFA Rules not processed for user `750b39980ed14876879b80fe6ca61482`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:50.586654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-773baabd-429b-4b82-b815-734d9e04fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:50.639772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:50.674003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 680/1370] 10.222.0.45 () {58 vars in 1061 bytes} [Mon Jul 25 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:50.682049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519be7-f60b-47d7-bf13-34f60c9ef72e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:50.686303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05519be7-f60b-47d7-bf13-34f60c9ef72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:50.743334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:50.800749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519be7-f60b-47d7-bf13-34f60c9ef72e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:50.879201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:50.879763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:50.880068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:50.880342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:50.881969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:50.985584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:51.000171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:51.002186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407c3f-9bc3-46ce-a865-dfbe6a450b7e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:51.020397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 691/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:51.268462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e32d-760f-4253-9f49-20b4169a37fb None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:51.268462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e32d-760f-4253-9f49-20b4169a37fb None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:51.268462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e32d-760f-4253-9f49-20b4169a37fb None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:51.269787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 681/1372] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:51.275496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab9f8-16e8-49ae-bd46-f5541b714947 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:51.275676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab9f8-16e8-49ae-bd46-f5541b714947 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:51.276339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab9f8-16e8-49ae-bd46-f5541b714947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:51.351159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-629ab9f8-16e8-49ae-bd46-f5541b714947 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:51.353027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-629ab9f8-16e8-49ae-bd46-f5541b714947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:51.458932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 692/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:51.502940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e32d-760f-4253-9f49-20b4169a37fb None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:51.504958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5cd0e32d-760f-4253-9f49-20b4169a37fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:51.650294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e32d-760f-4253-9f49-20b4169a37fb None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:51.705463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:51.768641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:51.769297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:51.769580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:51.769854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:51.771593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:51.862749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:51.864540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cad60-8ea9-48af-aa5d-1de30f9a8f37 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:51.882381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 682/1374] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:54.047407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985c4c-4cd9-48b2-9e48-9bf8b1f24e95 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:54.047407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985c4c-4cd9-48b2-9e48-9bf8b1f24e95 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:54.047407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17985c4c-4cd9-48b2-9e48-9bf8b1f24e95 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:54.048078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 693/1375] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:54.053287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb230a-8482-4b83-a090-7a0e9f721d85 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:54.053711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb230a-8482-4b83-a090-7a0e9f721d85 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:54.053847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb230a-8482-4b83-a090-7a0e9f721d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:54.130945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b8bb230a-8482-4b83-a090-7a0e9f721d85 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:54.132454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b8bb230a-8482-4b83-a090-7a0e9f721d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:54.147058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:54.241075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 683/1376] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:54.286760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985c4c-4cd9-48b2-9e48-9bf8b1f24e95 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:54.288313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-17985c4c-4cd9-48b2-9e48-9bf8b1f24e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:54.349400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:54.438182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17985c4c-4cd9-48b2-9e48-9bf8b1f24e95 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:54.583479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:54.584245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:54.584627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:54.585111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:54.586776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:54.615713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:54.714117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:54.715695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed694b9a-b876-4719-871e-841f37719cca service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:54.734653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 694/1377] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:41:56.985047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91e4e-ba80-4558-b1b7-015459a27a76 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:56.986064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91e4e-ba80-4558-b1b7-015459a27a76 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:56.986148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e91e4e-ba80-4558-b1b7-015459a27a76 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:56.988169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 684/1378] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:41:56.993283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fafe7-4beb-4aff-91f5-02905f000246 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:56.993760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fafe7-4beb-4aff-91f5-02905f000246 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:56.993853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fafe7-4beb-4aff-91f5-02905f000246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:57.066122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-252fafe7-4beb-4aff-91f5-02905f000246 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:41:57.067358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-252fafe7-4beb-4aff-91f5-02905f000246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:57.165764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:57.172038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 695/1379] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:41:57.218153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e91e4e-ba80-4558-b1b7-015459a27a76 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:41:57.220062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e2e91e4e-ba80-4558-b1b7-015459a27a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:57.366978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:57.379264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e91e4e-ba80-4558-b1b7-015459a27a76 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:41:57.515657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:41:57.516366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:41:57.516669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:41:57.517003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:41:57.518744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:41:57.615613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:41:57.617252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98cad8-4f8c-4b74-a518-6b8322fcb5c9 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:41:57.628383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:41:57.636792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 685/1380] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:00.006903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f990-9e9c-46e6-b6bc-3314bdaed233 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:00.007441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f990-9e9c-46e6-b6bc-3314bdaed233 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:00.007730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f990-9e9c-46e6-b6bc-3314bdaed233 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:00.009798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 696/1381] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:00.015163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51745c55-2d90-4e1f-93a8-12873d6c5748 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:00.015575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51745c55-2d90-4e1f-93a8-12873d6c5748 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:00.016002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51745c55-2d90-4e1f-93a8-12873d6c5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:00.088070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-51745c55-2d90-4e1f-93a8-12873d6c5748 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:00.089364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-51745c55-2d90-4e1f-93a8-12873d6c5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:00.199152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 686/1382] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:00.241898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6f990-9e9c-46e6-b6bc-3314bdaed233 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:00.243424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9ba6f990-9e9c-46e6-b6bc-3314bdaed233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:00.397202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6f990-9e9c-46e6-b6bc-3314bdaed233 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:00.464403 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:00.515861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:00.516934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:00.517236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:00.517760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:00.520000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:00.609575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:00.611705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428152-9b21-441e-8fd1-ffa6fc6e1c35 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:00.631344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 697/1383] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:02.683302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089efb7-e706-41ef-a072-e9a9ee9a8a32 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:02.683870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089efb7-e706-41ef-a072-e9a9ee9a8a32 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:02.684103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089efb7-e706-41ef-a072-e9a9ee9a8a32 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:02.685554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 687/1384] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:02.691696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593901e4-9f5d-4c4f-89fb-a541ce8cca57 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:02.693594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593901e4-9f5d-4c4f-89fb-a541ce8cca57 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:02.693594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593901e4-9f5d-4c4f-89fb-a541ce8cca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:02.763339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-593901e4-9f5d-4c4f-89fb-a541ce8cca57 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:02.764586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-593901e4-9f5d-4c4f-89fb-a541ce8cca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:02.805059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:02.874056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 698/1385] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:42:02.920913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089efb7-e706-41ef-a072-e9a9ee9a8a32 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:02.923613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2089efb7-e706-41ef-a072-e9a9ee9a8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:03.001204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:03.071525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089efb7-e706-41ef-a072-e9a9ee9a8a32 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:03.213830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:03.214838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:03.215205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:03.215643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:03.217854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:03.268425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:03.337420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:03.339525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4e915-b877-447a-a2ab-dce3d6573e35 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:03.364789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 688/1386] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:05.736616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc95a-421d-451b-b4a1-539d1b05105b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:05.737168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc95a-421d-451b-b4a1-539d1b05105b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:05.737168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc95a-421d-451b-b4a1-539d1b05105b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:05.738542 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 699/1387] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:05.743741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b618a1-157a-48b5-9299-a8c17b20d748 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:05.744231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b618a1-157a-48b5-9299-a8c17b20d748 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:05.744355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b618a1-157a-48b5-9299-a8c17b20d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:05.810442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-81b618a1-157a-48b5-9299-a8c17b20d748 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:05.811636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-81b618a1-157a-48b5-9299-a8c17b20d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:05.908864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 689/1388] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:05.953593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbc95a-421d-451b-b4a1-539d1b05105b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:05.955177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8cbc95a-421d-451b-b4a1-539d1b05105b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:06.102739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbc95a-421d-451b-b4a1-539d1b05105b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:06.119611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:06.218381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:06.218948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:06.219231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:06.219511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:06.222079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:06.312454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:06.314064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da2c75-1c7d-4688-a423-07869ac7f073 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:06.333249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 700/1389] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:06.391559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5795d-f734-4d0d-bb21-9cd5069d4b20 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:06.391843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5795d-f734-4d0d-bb21-9cd5069d4b20 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:06.392145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5795d-f734-4d0d-bb21-9cd5069d4b20 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:06.394266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 690/1390] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:06.399635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54fa87-ecac-4030-a984-2ff75dd992a4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:06.399909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54fa87-ecac-4030-a984-2ff75dd992a4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:06.400215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54fa87-ecac-4030-a984-2ff75dd992a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:06.427317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:06.470855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6e54fa87-ecac-4030-a984-2ff75dd992a4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:06.472043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6e54fa87-ecac-4030-a984-2ff75dd992a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:06.576124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 701/1391] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:06.635293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704ac1-d5ee-4dec-b0ef-9afb9a858e12 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:06.635670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704ac1-d5ee-4dec-b0ef-9afb9a858e12 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:06.636072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704ac1-d5ee-4dec-b0ef-9afb9a858e12 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:06.637548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 691/1392] 10.222.0.45 () {54 vars in 966 bytes} [Mon Jul 25 12:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:06.643885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8c839-f7e4-4e4f-ab5f-e69c70edac40 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:06.644362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8c839-f7e4-4e4f-ab5f-e69c70edac40 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:06.644647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8c839-f7e4-4e4f-ab5f-e69c70edac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:06.726780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bfa8c839-f7e4-4e4f-ab5f-e69c70edac40 None None] MFA Rules not processed for user `06abb3c5b9f842fca49b9a44e7feb99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:06.727902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bfa8c839-f7e4-4e4f-ab5f-e69c70edac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:06.769314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:06.806442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 702/1393] 10.222.0.45 () {58 vars in 1063 bytes} [Mon Jul 25 12:42:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:06.813940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704ac1-d5ee-4dec-b0ef-9afb9a858e12 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:06.815480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5e704ac1-d5ee-4dec-b0ef-9afb9a858e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:06.828932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:06.924591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704ac1-d5ee-4dec-b0ef-9afb9a858e12 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:06.998996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:06.999659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:06.999971 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:07.000253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:07.002398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:07.070892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:07.112727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:07.114154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d55181-c500-4a30-8c9b-51b9109a0f47 service glance] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:07.132893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 692/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:08.008091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f5e1-1033-43f0-9ceb-9eb0dc5109d0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.008584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f5e1-1033-43f0-9ceb-9eb0dc5109d0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.008679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f5e1-1033-43f0-9ceb-9eb0dc5109d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.077070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-61e8f5e1-1033-43f0-9ceb-9eb0dc5109d0 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:08.078278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-61e8f5e1-1033-43f0-9ceb-9eb0dc5109d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:08.167095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 703/1395] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:08.210261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ebb55-0759-4432-bea8-d3a8a36dfafe None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.210772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ebb55-0759-4432-bea8-d3a8a36dfafe None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.210898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ebb55-0759-4432-bea8-d3a8a36dfafe None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.212315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 693/1396] 10.222.0.45 () {54 vars in 943 bytes} [Mon Jul 25 12:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:08.218972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba23dc-e503-4c00-90e2-11568ccb38e3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.219260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba23dc-e503-4c00-90e2-11568ccb38e3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.219532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba23dc-e503-4c00-90e2-11568ccb38e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.290044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:08.297219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f2ba23dc-e503-4c00-90e2-11568ccb38e3 None None] MFA Rules not processed for user `137aecde49064a4abf74de30e9a85875`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:08.298415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f2ba23dc-e503-4c00-90e2-11568ccb38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:08.405685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 704/1397] 10.222.0.45 () {58 vars in 1040 bytes} [Mon Jul 25 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:42:08.416095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ebb55-0759-4432-bea8-d3a8a36dfafe None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:08.417613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a86ebb55-0759-4432-bea8-d3a8a36dfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:08.503858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d918-49ff-4c62-ab5f-468218c59cd5 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.504174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d918-49ff-4c62-ab5f-468218c59cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.504488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d918-49ff-4c62-ab5f-468218c59cd5 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.505977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 705/1398] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:42:08.510596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ca400-767c-44c2-8326-362084017416 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.510881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ca400-767c-44c2-8326-362084017416 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.511155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ca400-767c-44c2-8326-362084017416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.558423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ebb55-0759-4432-bea8-d3a8a36dfafe None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:08.577828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e72ca400-767c-44c2-8326-362084017416 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:08.579039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e72ca400-767c-44c2-8326-362084017416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:08.599950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:08.640645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:08.668338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:08.668984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.669277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.669559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.671215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:08.678203 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 706/1399] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:42:08.722627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ca400-767c-44c2-8326-362084017416 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:08.723833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e72ca400-767c-44c2-8326-362084017416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:08.760239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:08.761901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d1a7a-ca1c-4e3d-a20a-8c6f4792ef08 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:08.774165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 694/1400] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:42:08.847870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ca400-767c-44c2-8326-362084017416 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:08.927422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:08.965551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:08.967260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:08.967260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:08.967260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:08.968359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:09.061409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:09.063023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef2814-92ed-4487-b26e-5d93d7699936 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:09.082395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 707/1401] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:11.405880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5151-6717-4142-bb57-2f6a2dcd8541 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:11.406546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5151-6717-4142-bb57-2f6a2dcd8541 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:11.406546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f5151-6717-4142-bb57-2f6a2dcd8541 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:11.408565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 695/1402] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:11.413610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cea5e-ef50-454a-812c-8092938cd479 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:11.414048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cea5e-ef50-454a-812c-8092938cd479 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:11.414144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cea5e-ef50-454a-812c-8092938cd479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:11.488134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-639cea5e-ef50-454a-812c-8092938cd479 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:11.489669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-639cea5e-ef50-454a-812c-8092938cd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:11.533647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:11.599499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 708/1403] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:11.648273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f5151-6717-4142-bb57-2f6a2dcd8541 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:11.648273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ef3f5151-6717-4142-bb57-2f6a2dcd8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:11.729656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:11.808684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f5151-6717-4142-bb57-2f6a2dcd8541 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:11.931742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:11.932452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:11.932739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:11.933015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:11.934680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:11.968955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:12.038697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:12.040332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e23e5-222c-472a-8fd9-abc210ea91a2 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:12.060041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 696/1404] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:14.306834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743f16-4dd5-4518-b578-56e60f812532 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:14.307406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743f16-4dd5-4518-b578-56e60f812532 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:14.307406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743f16-4dd5-4518-b578-56e60f812532 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:14.308794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 709/1405] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:14.313935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f2f1a-4dac-4735-b585-463f39399cbb None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:14.314346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f2f1a-4dac-4735-b585-463f39399cbb None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:14.314768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f2f1a-4dac-4735-b585-463f39399cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:14.387717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-de8f2f1a-4dac-4735-b585-463f39399cbb None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:14.389343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-de8f2f1a-4dac-4735-b585-463f39399cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:14.502082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 697/1406] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:14.547824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743f16-4dd5-4518-b578-56e60f812532 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:14.549541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8743f16-4dd5-4518-b578-56e60f812532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:14.717056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743f16-4dd5-4518-b578-56e60f812532 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:14.740531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:14.847610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:14.848311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:14.848594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:14.848999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:14.850799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:15.073527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:15.075546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c5538-f4a4-4deb-a2c4-cef37906cebd service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:15.096847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 710/1407] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:24.499865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:25.093909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:32.567420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9763-d4a7-45d8-b336-46c3e3d5f069 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:32.568042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9763-d4a7-45d8-b336-46c3e3d5f069 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:32.568042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c9763-d4a7-45d8-b336-46c3e3d5f069 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:32.569457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 698/1408] 10.222.0.45 () {54 vars in 918 bytes} [Mon Jul 25 12:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:32.574511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282f33-5460-4808-acbc-f8d8adce6bfd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:32.575032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282f33-5460-4808-acbc-f8d8adce6bfd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:32.575032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06282f33-5460-4808-acbc-f8d8adce6bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:32.650261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-06282f33-5460-4808-acbc-f8d8adce6bfd None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:32.651468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06282f33-5460-4808-acbc-f8d8adce6bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:32.759846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 711/1409] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Jul 25 12:42:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:32.774349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e18c-11e5-4ca8-a039-d8957039ab7c None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:32.774640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e18c-11e5-4ca8-a039-d8957039ab7c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:32.774919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4e18c-11e5-4ca8-a039-d8957039ab7c None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:32.776321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 699/1410] 10.222.0.45 () {54 vars in 918 bytes} [Mon Jul 25 12:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:32.780892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2db8-f82d-4a77-bf70-13d2a24b4888 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:32.781182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2db8-f82d-4a77-bf70-13d2a24b4888 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:32.781459 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab2db8-f82d-4a77-bf70-13d2a24b4888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:32.855310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:32.857862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-94ab2db8-f82d-4a77-bf70-13d2a24b4888 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:32.859073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-94ab2db8-f82d-4a77-bf70-13d2a24b4888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:32.977174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 712/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Jul 25 12:42:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:35.484151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a9717-d57f-4296-b614-06575c4589df None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:35.484729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a9717-d57f-4296-b614-06575c4589df None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:35.484729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a9717-d57f-4296-b614-06575c4589df None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:35.486114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 700/1412] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:35.491332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442be3fa-5071-4c1b-b482-d8136fa27d6b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:35.491757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442be3fa-5071-4c1b-b482-d8136fa27d6b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:35.491871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442be3fa-5071-4c1b-b482-d8136fa27d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:35.565490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-442be3fa-5071-4c1b-b482-d8136fa27d6b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:35.566687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-442be3fa-5071-4c1b-b482-d8136fa27d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:35.622726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:35.663453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 713/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:35.706941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a9717-d57f-4296-b614-06575c4589df None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:35.708485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8c3a9717-d57f-4296-b614-06575c4589df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:35.850490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a9717-d57f-4296-b614-06575c4589df None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:35.921332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:35.960718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:35.961360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:35.961639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:35.961910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:35.963536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:36.050938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:36.052550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9491e-6c86-47cd-b3d7-bb2b682c208b service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:36.070275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 701/1414] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:36.963849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad7c4-3526-4e2c-895b-f2a5edc1a760 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:36.964424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad7c4-3526-4e2c-895b-f2a5edc1a760 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:36.964424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad7c4-3526-4e2c-895b-f2a5edc1a760 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:36.965760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 714/1415] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:36.971801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0e8c-d5e2-45d5-ac48-dd9f90908667 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:36.972252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0e8c-d5e2-45d5-ac48-dd9f90908667 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:36.972399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd0e8c-d5e2-45d5-ac48-dd9f90908667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:37.047312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5ccd0e8c-d5e2-45d5-ac48-dd9f90908667 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:37.048521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5ccd0e8c-d5e2-45d5-ac48-dd9f90908667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:37.074487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:37.143351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 702/1416] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:37.293663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad7c4-3526-4e2c-895b-f2a5edc1a760 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:37.295217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-764ad7c4-3526-4e2c-895b-f2a5edc1a760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:37.437861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad7c4-3526-4e2c-895b-f2a5edc1a760 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:37.481268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:37.559319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:37.559875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:37.560180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:37.560454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:37.562086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:37.651238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:37.652853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d8eba-cc00-4814-a25f-273bb4e2a78c service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:37.670858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 715/1417] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:38.555098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7b82-6a07-4def-b881-5c649c8a0164 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:38.555676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7b82-6a07-4def-b881-5c649c8a0164 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:38.555676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7b82-6a07-4def-b881-5c649c8a0164 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:38.557116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 703/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:38.562223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0567b-7db7-46a6-9c95-f364b8626ee5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:38.562639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0567b-7db7-46a6-9c95-f364b8626ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:38.562752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0567b-7db7-46a6-9c95-f364b8626ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:38.618950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:38.641833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-acc0567b-7db7-46a6-9c95-f364b8626ee5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:38.643052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-acc0567b-7db7-46a6-9c95-f364b8626ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:38.744093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 716/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:38.898218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7b82-6a07-4def-b881-5c649c8a0164 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:38.899874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-305f7b82-6a07-4def-b881-5c649c8a0164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:39.041753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7b82-6a07-4def-b881-5c649c8a0164 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:39.054275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:39.153300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:39.153870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:39.154150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:39.154451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:39.156133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:39.244467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:39.246335 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ede47-4ff3-4a14-a068-8c72c7a225d1 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:39.266092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 704/1420] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:40.131489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e019b-c8de-469c-908d-19e6b51a5e4a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:40.131987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e019b-c8de-469c-908d-19e6b51a5e4a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:40.132090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e019b-c8de-469c-908d-19e6b51a5e4a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:40.133498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 717/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:40.138517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1003b96-5bad-4d17-b1fa-c68e6388ded5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:40.138936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1003b96-5bad-4d17-b1fa-c68e6388ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:40.139091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1003b96-5bad-4d17-b1fa-c68e6388ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:40.159132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:40.215438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c1003b96-5bad-4d17-b1fa-c68e6388ded5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:40.216675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c1003b96-5bad-4d17-b1fa-c68e6388ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:40.313636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 705/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:40.467405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e019b-c8de-469c-908d-19e6b51a5e4a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:40.468920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e98e019b-c8de-469c-908d-19e6b51a5e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:40.581917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:40.617596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e019b-c8de-469c-908d-19e6b51a5e4a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:40.733159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:40.733801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:40.734079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:40.734365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:40.736779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:40.812616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:40.826703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:40.828349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e19f33-dea7-44fb-8bff-bdb8b77416da service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:40.847216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 718/1423] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:41.741941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35604-ddef-4701-8d1b-c3e0aa55a7e4 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:41.742475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35604-ddef-4701-8d1b-c3e0aa55a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:41.742622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b35604-ddef-4701-8d1b-c3e0aa55a7e4 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:41.743895 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 706/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:41.749440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0922649-27e4-4ea0-8511-b7bd276e15ff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:41.749863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0922649-27e4-4ea0-8511-b7bd276e15ff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:41.749983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0922649-27e4-4ea0-8511-b7bd276e15ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:41.842049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c0922649-27e4-4ea0-8511-b7bd276e15ff None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:41.843306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c0922649-27e4-4ea0-8511-b7bd276e15ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:41.944809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 719/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:42.098722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35604-ddef-4701-8d1b-c3e0aa55a7e4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:42.100291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-31b35604-ddef-4701-8d1b-c3e0aa55a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:42.188636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:42.265881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b35604-ddef-4701-8d1b-c3e0aa55a7e4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:42.397961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:42.426510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:42.426510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:42.426510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:42.426510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:42.453456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:42.497838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:42.499459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d78f5-f92f-460d-ad6d-c08ce64d9ed0 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:42.524051 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 707/1426] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:43.433606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adfe5b-2836-48c5-87cb-da778aecc91b None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:43.434200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adfe5b-2836-48c5-87cb-da778aecc91b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:43.434200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adfe5b-2836-48c5-87cb-da778aecc91b None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:43.435545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 720/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:43.440682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11ec4-8ba4-4892-9344-83490a1d6ac1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:43.441160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11ec4-8ba4-4892-9344-83490a1d6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:43.441267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec11ec4-8ba4-4892-9344-83490a1d6ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:43.526779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6ec11ec4-8ba4-4892-9344-83490a1d6ac1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:43.528009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6ec11ec4-8ba4-4892-9344-83490a1d6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:43.634301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 708/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:43.789339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adfe5b-2836-48c5-87cb-da778aecc91b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:43.790885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-31adfe5b-2836-48c5-87cb-da778aecc91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:43.851237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:43.959830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adfe5b-2836-48c5-87cb-da778aecc91b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:44.081254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:44.081894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:44.082180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:44.082462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:44.084149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:44.090908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:44.177342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:44.178952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9006e47-f257-43bf-b9c8-1f09435d125c service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:44.196815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 721/1429] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:45.105212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c675-d0f1-4764-836a-7689f95e9be0 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:45.105844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c675-d0f1-4764-836a-7689f95e9be0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:45.105844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70c675-d0f1-4764-836a-7689f95e9be0 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:45.107696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 709/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:45.113446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0dc0-ba0b-4335-bca7-a77c83d9971f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:45.113902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0dc0-ba0b-4335-bca7-a77c83d9971f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:45.114014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0dc0-ba0b-4335-bca7-a77c83d9971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:45.192162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d0da0dc0-ba0b-4335-bca7-a77c83d9971f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:45.193436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d0da0dc0-ba0b-4335-bca7-a77c83d9971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:45.266553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:45.299454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 722/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:45.453037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c675-d0f1-4764-836a-7689f95e9be0 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:45.455432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-dc70c675-d0f1-4764-836a-7689f95e9be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:45.473438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:45.617777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70c675-d0f1-4764-836a-7689f95e9be0 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:45.728204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:45.755393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:45.756084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:45.756391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:45.756669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:45.758372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:45.850185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:45.851769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44321-a161-49b9-affe-29652bd7a5c6 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:45.871344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 710/1432] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:46.799292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02de781-6b4a-4312-880b-bd17a858e4da None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:46.799855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02de781-6b4a-4312-880b-bd17a858e4da None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:46.799855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02de781-6b4a-4312-880b-bd17a858e4da None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:46.801265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 723/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:46.808707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e0885-8c5d-4409-87c7-8d1d824e12d6 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:46.809129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e0885-8c5d-4409-87c7-8d1d824e12d6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:46.809265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e0885-8c5d-4409-87c7-8d1d824e12d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:46.893309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c19e0885-8c5d-4409-87c7-8d1d824e12d6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:46.894523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c19e0885-8c5d-4409-87c7-8d1d824e12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:46.939053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:47.018675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 711/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:47.178232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02de781-6b4a-4312-880b-bd17a858e4da None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:47.180427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a02de781-6b4a-4312-880b-bd17a858e4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:47.375954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02de781-6b4a-4312-880b-bd17a858e4da None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:47.432142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:47.491718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:47.492389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:47.492672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:47.492948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:47.494602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:47.591627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:47.594116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658110db-a4d6-4138-af26-140c50d70e99 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:47.613353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 724/1435] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:48.646973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb600-ac15-4434-ad1d-53c4700981d6 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:48.647517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb600-ac15-4434-ad1d-53c4700981d6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:48.647517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bb600-ac15-4434-ad1d-53c4700981d6 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:48.648990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 712/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:48.654807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63e58-da1b-4c06-9e2b-a08b9313e0a1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:48.655614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63e58-da1b-4c06-9e2b-a08b9313e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:48.655614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63e58-da1b-4c06-9e2b-a08b9313e0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:48.762461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bfa63e58-da1b-4c06-9e2b-a08b9313e0a1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:48.764705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bfa63e58-da1b-4c06-9e2b-a08b9313e0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:48.768689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:48.880222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 725/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:42:49.043057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb600-ac15-4434-ad1d-53c4700981d6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:49.044626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ca5bb600-ac15-4434-ad1d-53c4700981d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:49.254864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bb600-ac15-4434-ad1d-53c4700981d6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:49.288944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:49.375390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:49.375991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:49.376274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:49.376553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:49.378200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:49.481043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:49.484325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19adf0-0126-472c-8c5f-02bf3983d5fa service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:49.503647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 713/1438] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:51.742223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff3af-a305-466a-8900-0178210bb40a None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:51.742780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff3af-a305-466a-8900-0178210bb40a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:51.742780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff3af-a305-466a-8900-0178210bb40a None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:51.744278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 726/1439] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:51.750571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6eea-8cc6-49bc-9a83-9a7fc163f669 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:51.751019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6eea-8cc6-49bc-9a83-9a7fc163f669 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:51.751119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6eea-8cc6-49bc-9a83-9a7fc163f669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:51.791090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:51.816126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a91f6eea-8cc6-49bc-9a83-9a7fc163f669 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:51.817735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a91f6eea-8cc6-49bc-9a83-9a7fc163f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:51.911738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 714/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:51.950705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff3af-a305-466a-8900-0178210bb40a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:51.952268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-36cff3af-a305-466a-8900-0178210bb40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:52.053664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff3af-a305-466a-8900-0178210bb40a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:52.084275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:52.126674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:52.127317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:52.127605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:52.127878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:52.129724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:52.237224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:52.238676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd957845-3919-47f5-a97a-6699c02982dd service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:52.257484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 727/1441] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:54.465098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e70fcb-4759-4fc6-988a-d1f8bac1a123 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:54.465676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e70fcb-4759-4fc6-988a-d1f8bac1a123 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:54.466037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e70fcb-4759-4fc6-988a-d1f8bac1a123 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:54.469262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 715/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:42:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:42:54.475684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0fde6-6a12-4098-8ac0-37ca4611b3e9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:54.476154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0fde6-6a12-4098-8ac0-37ca4611b3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:54.476412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0fde6-6a12-4098-8ac0-37ca4611b3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:54.559406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dcb0fde6-6a12-4098-8ac0-37ca4611b3e9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:54.560638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dcb0fde6-6a12-4098-8ac0-37ca4611b3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:54.573606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:54.671653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 728/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:42:54.714661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e70fcb-4759-4fc6-988a-d1f8bac1a123 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:54.717338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-82e70fcb-4759-4fc6-988a-d1f8bac1a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:54.864409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e70fcb-4759-4fc6-988a-d1f8bac1a123 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:54.878334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:54.957023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:54.957976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:54.958270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:54.958682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:54.960279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:55.105743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:55.107430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc449-163d-4d56-a2e8-47e78d2f45f3 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:55.135442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 716/1444] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:42:57.607597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7546-9784-4c34-8829-adc6d6860495 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:57.608346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7546-9784-4c34-8829-adc6d6860495 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:57.608549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7546-9784-4c34-8829-adc6d6860495 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:57.611121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 729/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:42:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:42:57.617570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a5dcf-b6df-446f-b961-bb14666e3ab2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:57.618229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a5dcf-b6df-446f-b961-bb14666e3ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:57.618229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a5dcf-b6df-446f-b961-bb14666e3ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:57.674738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:57.701485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-457a5dcf-b6df-446f-b961-bb14666e3ab2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:42:57.703014 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-457a5dcf-b6df-446f-b961-bb14666e3ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:57.834817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 717/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:42:57.876397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7546-9784-4c34-8829-adc6d6860495 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:42:57.878033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6c1e7546-9784-4c34-8829-adc6d6860495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:58.001669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e7546-9784-4c34-8829-adc6d6860495 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:42:58.049400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:42:58.091574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:42:58.092350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:42:58.092672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:42:58.092996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:42:58.094998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:42:58.254470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:42:58.257085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116624c-80ec-4ba5-8365-f4216e9fe041 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:42:58.289582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 730/1447] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:43:00.508068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c54d53-4c0a-4d0f-868f-472dcef43a4c None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:00.508657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c54d53-4c0a-4d0f-868f-472dcef43a4c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:00.508657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c54d53-4c0a-4d0f-868f-472dcef43a4c None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:00.510064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 718/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:00.516429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb49ed1-a2fc-4d5e-bafe-49ca4061a069 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:00.516975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb49ed1-a2fc-4d5e-bafe-49ca4061a069 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:00.516975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb49ed1-a2fc-4d5e-bafe-49ca4061a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:00.587496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-deb49ed1-a2fc-4d5e-bafe-49ca4061a069 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:00.588746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-deb49ed1-a2fc-4d5e-bafe-49ca4061a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:00.611785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:00.690549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 731/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:00.752498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773e72-2605-40ad-8828-665e8a78e94b None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:00.752789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773e72-2605-40ad-8828-665e8a78e94b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:00.753069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773e72-2605-40ad-8828-665e8a78e94b None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:00.754458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 719/1450] 10.222.0.45 () {54 vars in 965 bytes} [Mon Jul 25 12:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:00.760649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c6023-5e72-4fb0-9edc-bc3233329d4e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:00.760934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c6023-5e72-4fb0-9edc-bc3233329d4e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:00.761215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c6023-5e72-4fb0-9edc-bc3233329d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:00.836484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-204c6023-5e72-4fb0-9edc-bc3233329d4e None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:00.837833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-204c6023-5e72-4fb0-9edc-bc3233329d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:00.914656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 732/1451] 10.222.0.45 () {58 vars in 1062 bytes} [Mon Jul 25 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:00.923792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773e72-2605-40ad-8828-665e8a78e94b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:00.925346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5b773e72-2605-40ad-8828-665e8a78e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:01.030519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773e72-2605-40ad-8828-665e8a78e94b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:01.049813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:01.103255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:01.103911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:01.104229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:01.104506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:01.106238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:01.213803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:01.215157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed4aea-1ffc-46f0-b5db-f1b35102cc62 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:01.232787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 720/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:03.769033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7fe1d-8616-4b87-a89f-ce6872e4e3b2 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:03.769577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7fe1d-8616-4b87-a89f-ce6872e4e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:03.769577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7fe1d-8616-4b87-a89f-ce6872e4e3b2 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:03.771057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:03.776635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8fa83-63f7-4140-b04a-a484d20f8e48 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:03.777078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8fa83-63f7-4140-b04a-a484d20f8e48 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:03.777176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8fa83-63f7-4140-b04a-a484d20f8e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:03.842750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:03.846218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-bbe8fa83-63f7-4140-b04a-a484d20f8e48 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:03.847476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bbe8fa83-63f7-4140-b04a-a484d20f8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:03.946778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:03.986210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7fe1d-8616-4b87-a89f-ce6872e4e3b2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:03.987747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f9a7fe1d-8616-4b87-a89f-ce6872e4e3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:04.006027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:04.091745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7fe1d-8616-4b87-a89f-ce6872e4e3b2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:04.165782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:04.166428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:04.166706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:04.166977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:04.168659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:04.239021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:04.281068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:04.282510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4a21d-cde6-4d16-a11a-9415fab76ac4 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:04.301629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 734/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:06.547189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b32630-62b1-4d4d-bac1-53992fa94774 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:06.547728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b32630-62b1-4d4d-bac1-53992fa94774 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:06.547728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b32630-62b1-4d4d-bac1-53992fa94774 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:06.549167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:06.554508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f8ee-b940-4937-a773-91a89079ef2e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:06.554938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f8ee-b940-4937-a773-91a89079ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:06.555063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3f8ee-b940-4937-a773-91a89079ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:06.621578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2ff3f8ee-b940-4937-a773-91a89079ef2e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:06.622699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ff3f8ee-b940-4937-a773-91a89079ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:06.728237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:06.769277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b32630-62b1-4d4d-bac1-53992fa94774 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:06.771031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a0b32630-62b1-4d4d-bac1-53992fa94774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:06.878719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b32630-62b1-4d4d-bac1-53992fa94774 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:06.906661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:06.954106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:06.954751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:06.955030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:06.955298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:06.957074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:07.068031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:07.069476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a367df-a763-48e7-a8e5-c41f1ac9519b service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:07.087298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 723/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:09.197573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d423-de9c-44cd-bc4c-438f3d970b53 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:09.198363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d423-de9c-44cd-bc4c-438f3d970b53 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:09.198562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d423-de9c-44cd-bc4c-438f3d970b53 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:09.201399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:09.208685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbd197-399e-4faf-b01a-4e27519e933a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:09.209192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbd197-399e-4faf-b01a-4e27519e933a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:09.209323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbd197-399e-4faf-b01a-4e27519e933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:09.307377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e7bbd197-399e-4faf-b01a-4e27519e933a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:09.308653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e7bbd197-399e-4faf-b01a-4e27519e933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:09.319551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:09.425527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:43:09.465550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d423-de9c-44cd-bc4c-438f3d970b53 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:09.467177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1df4d423-de9c-44cd-bc4c-438f3d970b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:09.507749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:09.614813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d423-de9c-44cd-bc4c-438f3d970b53 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:09.720739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:09.721340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:09.721820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:09.722123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:09.724191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:09.831059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:09.875501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:09.877369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09806c3e-608d-4091-88fb-e9d2f13614db service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:09.900338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 737/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:12.128340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd9599-da06-4914-923b-f670e0d2c06f None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:12.128884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd9599-da06-4914-923b-f670e0d2c06f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:12.128884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd9599-da06-4914-923b-f670e0d2c06f None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:12.130288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:12.135626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724431-ce9f-4629-8575-274b51fef449 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:12.136060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724431-ce9f-4629-8575-274b51fef449 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:12.136215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724431-ce9f-4629-8575-274b51fef449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:12.203665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cf724431-ce9f-4629-8575-274b51fef449 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:12.204953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cf724431-ce9f-4629-8575-274b51fef449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:12.304273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:43:12.342154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd9599-da06-4914-923b-f670e0d2c06f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:12.344229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-27fd9599-da06-4914-923b-f670e0d2c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:12.450758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd9599-da06-4914-923b-f670e0d2c06f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:12.608649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:12.647225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:12.647874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:12.648196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:12.648471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:12.650233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:12.764670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:12.766253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7aac6-3495-46aa-af45-6d340c4dddcb service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:12.784398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 726/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:14.845203 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f53ea-9642-481f-9ae8-0407af3a1214 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:14.846050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f53ea-9642-481f-9ae8-0407af3a1214 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:14.846050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f53ea-9642-481f-9ae8-0407af3a1214 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:14.847429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:43:14.853846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723248-6461-4b8d-8a47-ca8a79f9979a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:14.854735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723248-6461-4b8d-8a47-ca8a79f9979a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:14.854925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e723248-6461-4b8d-8a47-ca8a79f9979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:14.923226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2e723248-6461-4b8d-8a47-ca8a79f9979a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:14.924492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2e723248-6461-4b8d-8a47-ca8a79f9979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:14.943507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:15.025430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:43:15.063797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f53ea-9642-481f-9ae8-0407af3a1214 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:15.065366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9f3f53ea-9642-481f-9ae8-0407af3a1214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:15.103583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:15.188414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f53ea-9642-481f-9ae8-0407af3a1214 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:15.266139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:15.266795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:15.267071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:15.267339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:15.269105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:15.353535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:15.381911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:15.383341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c89b17-989f-45e1-8647-f62f3e74d9fc service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:15.401837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 740/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:17.488005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483ede-a513-40d6-be22-d3bb4e81ab56 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:17.488561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483ede-a513-40d6-be22-d3bb4e81ab56 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:17.488561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483ede-a513-40d6-be22-d3bb4e81ab56 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:17.489967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:17.495302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da337-ede1-41e8-a1e0-2c530011f68c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:17.496025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da337-ede1-41e8-a1e0-2c530011f68c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:17.496163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da337-ede1-41e8-a1e0-2c530011f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:17.564303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ff9da337-ede1-41e8-a1e0-2c530011f68c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:17.565484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff9da337-ede1-41e8-a1e0-2c530011f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:17.660222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:17.697595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33483ede-a513-40d6-be22-d3bb4e81ab56 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:17.699111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-33483ede-a513-40d6-be22-d3bb4e81ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:17.809269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33483ede-a513-40d6-be22-d3bb4e81ab56 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:17.875279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:17.904507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:17.905157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:17.905439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:17.906269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:17.907946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:18.018632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:18.020118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf4478-d038-41e5-bb67-45b868a5f552 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:18.039253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 729/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:27.658472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:28.036876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=66 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:37.716637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03fbb-7717-4f1e-98de-83526d5b7e17 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:37.717669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03fbb-7717-4f1e-98de-83526d5b7e17 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:37.717831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e03fbb-7717-4f1e-98de-83526d5b7e17 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:37.719421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 742/1471] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:37.724789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877258f-1fd0-4cc9-b1fa-be8ce7a11a36 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:37.725228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877258f-1fd0-4cc9-b1fa-be8ce7a11a36 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:37.725331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877258f-1fd0-4cc9-b1fa-be8ce7a11a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:37.790120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e877258f-1fd0-4cc9-b1fa-be8ce7a11a36 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:37.791327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e877258f-1fd0-4cc9-b1fa-be8ce7a11a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:37.887100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 730/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:37.970553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ec78-eeaa-454c-b9f2-f6e675082155 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:37.970839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ec78-eeaa-454c-b9f2-f6e675082155 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:37.971114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569ec78-eeaa-454c-b9f2-f6e675082155 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:37.972493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 743/1473] 10.222.0.45 () {54 vars in 966 bytes} [Mon Jul 25 12:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:37.977234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156771f7-b9db-4d27-9998-c1978e849ee4 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:37.977522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156771f7-b9db-4d27-9998-c1978e849ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:37.977820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156771f7-b9db-4d27-9998-c1978e849ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:38.055057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-156771f7-b9db-4d27-9998-c1978e849ee4 None None] MFA Rules not processed for user `06abb3c5b9f842fca49b9a44e7feb99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:38.056437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-156771f7-b9db-4d27-9998-c1978e849ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:38.077762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:38.132574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 731/1474] 10.222.0.45 () {58 vars in 1063 bytes} [Mon Jul 25 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:38.140800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ec78-eeaa-454c-b9f2-f6e675082155 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:38.142336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3569ec78-eeaa-454c-b9f2-f6e675082155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:38.242891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569ec78-eeaa-454c-b9f2-f6e675082155 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:38.316634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:38.317274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:38.317557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:38.317830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:38.319472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:38.372285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:38.426681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:38.428145 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ff957-2e22-45f5-9f4b-5b0d1aaaed2b service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:38.446833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 744/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:40.542458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6371d3-089b-47ed-9420-dfb014e64ae5 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:40.543022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6371d3-089b-47ed-9420-dfb014e64ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:40.543022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6371d3-089b-47ed-9420-dfb014e64ae5 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:40.544458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 732/1476] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:40.549756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd4ab-93ae-4699-ae46-a2158b4de5c8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:40.550189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd4ab-93ae-4699-ae46-a2158b4de5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:40.550300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd4ab-93ae-4699-ae46-a2158b4de5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:40.614543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-262dd4ab-93ae-4699-ae46-a2158b4de5c8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:40.615663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-262dd4ab-93ae-4699-ae46-a2158b4de5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:40.717988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 745/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:40.740868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6371d3-089b-47ed-9420-dfb014e64ae5 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:40.742415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0c6371d3-089b-47ed-9420-dfb014e64ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:40.865011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6371d3-089b-47ed-9420-dfb014e64ae5 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:40.911493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:40.954715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:40.955390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:40.955644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:40.955932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:40.956662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:40.958379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:43:40.958379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:43:40.958379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:43:40.959499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfce2cd-b989-4a0e-9b7f-d56f5d9317f0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:40.978646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 733/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Mon Jul 25 12:43:40 2022] GET /identity/v3/projects => generated 2553 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:43:42.990487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78271ce-fb05-4d27-868f-829cb5b7911c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:42.991032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78271ce-fb05-4d27-868f-829cb5b7911c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:42.991032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78271ce-fb05-4d27-868f-829cb5b7911c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:42.992458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 746/1479] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:42.998617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455f2e-476e-4182-875e-acae33755d6c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:42.999023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455f2e-476e-4182-875e-acae33755d6c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:42.999190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455f2e-476e-4182-875e-acae33755d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:43.063302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-06455f2e-476e-4182-875e-acae33755d6c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:43.064527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-06455f2e-476e-4182-875e-acae33755d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:43.160331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 734/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:43.203950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78271ce-fb05-4d27-868f-829cb5b7911c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:43.205506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a78271ce-fb05-4d27-868f-829cb5b7911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:43.215133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:43.350996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78271ce-fb05-4d27-868f-829cb5b7911c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:43.430272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:43.462206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:43.462846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:43.463124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:43.463396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:43.465076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:43.559417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:43.561734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac3053-b962-4c07-a96f-77e4ab9bdc04 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:43.579580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 747/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:45.769727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf79a9-a4cc-4133-9d38-a67029b4981a None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:45.770316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf79a9-a4cc-4133-9d38-a67029b4981a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:45.770316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf79a9-a4cc-4133-9d38-a67029b4981a None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:45.771722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 735/1482] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:45.777589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2fff-358c-4365-9ccb-847599b5a698 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:45.778461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2fff-358c-4365-9ccb-847599b5a698 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:45.778461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b2fff-358c-4365-9ccb-847599b5a698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:45.843529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6f4b2fff-358c-4365-9ccb-847599b5a698 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:45.844784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6f4b2fff-358c-4365-9ccb-847599b5a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:45.893390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:45.945699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 748/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:45.984450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf79a9-a4cc-4133-9d38-a67029b4981a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:45.985981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6aaf79a9-a4cc-4133-9d38-a67029b4981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:46.009362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:46.092103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf79a9-a4cc-4133-9d38-a67029b4981a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:46.164023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:46.164664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:46.164941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:46.165211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:46.166842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:46.238366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:46.273399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:46.274849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87419c-a51b-41d3-a13c-79227a499b6f service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:46.292569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 736/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:48.339931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af510-82b6-426a-90a0-01af5f8ebd16 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:48.340507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af510-82b6-426a-90a0-01af5f8ebd16 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:48.340507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6af510-82b6-426a-90a0-01af5f8ebd16 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:48.342439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 749/1485] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:48.347818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32168-0ef6-4515-8662-797507573ff2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:48.348282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32168-0ef6-4515-8662-797507573ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:48.348433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d32168-0ef6-4515-8662-797507573ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:48.414399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-59d32168-0ef6-4515-8662-797507573ff2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:48.415609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-59d32168-0ef6-4515-8662-797507573ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:48.511991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 737/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:48.550638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af510-82b6-426a-90a0-01af5f8ebd16 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:48.552227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4d6af510-82b6-426a-90a0-01af5f8ebd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:48.656950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6af510-82b6-426a-90a0-01af5f8ebd16 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:48.734109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:48.735773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:48.739781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:48.739781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:48.739781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:48.739781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:48.845090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:48.846518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88317425-4c3e-4bde-b94d-2cdf3446f23c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:48.865461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 750/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:43:51.018432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7285-f15a-4e8a-bad7-2e3dec5d93b8 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:51.018983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7285-f15a-4e8a-bad7-2e3dec5d93b8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:51.018983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7285-f15a-4e8a-bad7-2e3dec5d93b8 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:51.020433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 738/1488] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:51.025527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56312f-f13c-48db-a2a6-a6fb15b2862b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:51.025963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56312f-f13c-48db-a2a6-a6fb15b2862b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:51.026066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56312f-f13c-48db-a2a6-a6fb15b2862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:51.089959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3a56312f-f13c-48db-a2a6-a6fb15b2862b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:51.091156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3a56312f-f13c-48db-a2a6-a6fb15b2862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:51.142842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:51.186180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 751/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:43:51.225890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7285-f15a-4e8a-bad7-2e3dec5d93b8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:51.227424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fb1a7285-f15a-4e8a-bad7-2e3dec5d93b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:51.263863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:51.331425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7285-f15a-4e8a-bad7-2e3dec5d93b8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:51.402617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:51.403259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:51.403542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:51.403899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:51.405691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:51.485203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:51.520434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:51.521891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fbd62-d355-458b-8e74-b62412df93a1 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:51.539746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 739/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:43:54.031518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71386ba-3d06-46f9-8fad-e1f597fdebe0 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:54.032127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71386ba-3d06-46f9-8fad-e1f597fdebe0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:54.032127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71386ba-3d06-46f9-8fad-e1f597fdebe0 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:54.033469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 752/1491] 10.222.0.45 () {54 vars in 926 bytes} [Mon Jul 25 12:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:43:54.038627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2914-76e7-483c-a685-e48489c6f451 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:54.039005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2914-76e7-483c-a685-e48489c6f451 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:54.039175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b2914-76e7-483c-a685-e48489c6f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:54.104002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-464b2914-76e7-483c-a685-e48489c6f451 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:43:54.105219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-464b2914-76e7-483c-a685-e48489c6f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:54.199736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 740/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Mon Jul 25 12:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:43:54.239002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71386ba-3d06-46f9-8fad-e1f597fdebe0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:43:54.240658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d71386ba-3d06-46f9-8fad-e1f597fdebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:54.349032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71386ba-3d06-46f9-8fad-e1f597fdebe0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:43:54.422256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:43:54.422892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:43:54.423172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:43:54.423442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:43:54.425122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:43:54.433884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:43:54.532604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:43:54.534071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d0538-980b-4bed-a50c-9750e5b1de08 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:43:54.552458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 753/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:44:04.197928 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=82 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:44:04.550166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=50 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:37.460966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:37.461580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:37.461580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:37.536464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:45:37.537679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:37.632947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 741/1494] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:45:37.641534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:37.642032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:37.642139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:37.717220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:45:37.718364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:37.813416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 754/1495] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:45:37.818037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:37.819237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:37.830524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66f799-62e3-4423-b1a2-f223c764ee17 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:37.890744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:37.923852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:37.924534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:37.924811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:37.925079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:37.925787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:45:37.926086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:37.927114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:37.927114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:45:37.927114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:45:37.928016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:37.940107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 742/1496] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:45:37.948213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:37.957244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ce1ca-4618-49a9-bdab-c03a4c9d8f91 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:38.017748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:38.052927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:38.053574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:38.053850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:38.054126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:38.054805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:38.056545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:38.056545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:45:38.056545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:45:38.057763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:38.175753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 755/1497] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:45:37 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:45:38.180489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:38.182016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:38.215402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5f7c9-28a7-4dd7-b31a-9cb8b2299938 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:38.307413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:38.308026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:38.308310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:38.308585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:38.309283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:38.310289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:38.310289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:45:38.310289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:45:38.311492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:38.397122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 743/1498] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:45:38 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:45:38.402319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:38.403907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:38.466497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade1dbc-6b0c-4d77-bcfc-1a93ba2e2356 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:38.548685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:38.561850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:38.561850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:38.561850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:38.561850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:38.562272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:38.562272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:38.562272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:45:38.562272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:45:38.562588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:38.575345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 756/1499] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:45:38.579084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:38.580672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:38.592716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24872ff-7285-442a-a7fd-ad2c409728d3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:38.617873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:38.687609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:38.688452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:38.688729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:38.689003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:38.689725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:38.690734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:38.690734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:45:38.690734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:45:38.691612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd442dd8-b826-4882-8776-850b5fce0f7b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:38.704792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 744/1500] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:45:38.708961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:38.710478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:38.744977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc546ab-37dd-4670-bf1c-1439d73762ea admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:38.838522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:38.839411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:38.839691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:38.839989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] PATH_INFO: `/v3/projects/7c06e9df176147bba5ec3d39e269547f/users/bd75f0fa95c5497797f65dbfdb840aed/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:38.861269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c06e9df176147bba5ec3d39e269547f, user_id=bd75f0fa95c5497797f65dbfdb840aed, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:38.862298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:38.862298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:45:38.862298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:45:38.864265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55d5f-81a0-4dc1-9bce-5a4b7d93fb91 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:38.943584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 757/1501] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:45:38 2022] PUT /identity/v3/projects/7c06e9df176147bba5ec3d39e269547f/users/bd75f0fa95c5497797f65dbfdb840aed/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:45:38.956544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204037-99d8-4a50-808c-cb6946a0abc1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:38.956836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204037-99d8-4a50-808c-cb6946a0abc1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:38.957205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c204037-99d8-4a50-808c-cb6946a0abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:39.013027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8c204037-99d8-4a50-808c-cb6946a0abc1 None None] MFA Rules not processed for user `bd75f0fa95c5497797f65dbfdb840aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:45:39.014219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8c204037-99d8-4a50-808c-cb6946a0abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:39.090018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 745/1502] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:45:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:45:39.102922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecc28-bb3f-4dd3-82fd-6a3e0210f606 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:39.103214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecc28-bb3f-4dd3-82fd-6a3e0210f606 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:39.103494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eecc28-bb3f-4dd3-82fd-6a3e0210f606 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:39.104905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 758/1503] 10.222.0.45 () {54 vars in 964 bytes} [Mon Jul 25 12:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:45:39.109706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03c38-8f93-4429-adf4-a39116e5fc44 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:39.109990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03c38-8f93-4429-adf4-a39116e5fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:39.110264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03c38-8f93-4429-adf4-a39116e5fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:39.142235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:39.186906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-cac03c38-8f93-4429-adf4-a39116e5fc44 None None] MFA Rules not processed for user `750b39980ed14876879b80fe6ca61482`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:45:39.188145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-cac03c38-8f93-4429-adf4-a39116e5fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:39.262210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 746/1504] 10.222.0.45 () {58 vars in 1061 bytes} [Mon Jul 25 12:45:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:45:39.270045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecc28-bb3f-4dd3-82fd-6a3e0210f606 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:39.271564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-76eecc28-bb3f-4dd3-82fd-6a3e0210f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:39.320380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:39.372934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eecc28-bb3f-4dd3-82fd-6a3e0210f606 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:39.445451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:39.446069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:39.446351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:39.446624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:39.448887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:39.544622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:39.546041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:39.549540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:39.564054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 759/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:45:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:45:39.608678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d47a8-66b2-4f41-b38d-6b07b2ac02be None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:39.609116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d47a8-66b2-4f41-b38d-6b07b2ac02be None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:39.609222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d47a8-66b2-4f41-b38d-6b07b2ac02be None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:39.610546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 747/1506] 10.222.0.45 () {52 vars in 830 bytes} [Mon Jul 25 12:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:45:39.614259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:39.615486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:39.714395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3df0ea-57d9-42c0-802b-fc82b01966e0 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:39.810956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:39.811816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:39.812124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:39.812396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] PATH_INFO: `/v3/users/bd75f0fa95c5497797f65dbfdb840aed` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:39.825239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd75f0fa95c5497797f65dbfdb840aed)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:39.826260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:39.826260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:45:39.826260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:45:39.827463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:39.837187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:40.036131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd75f0fa95c5497797f65dbfdb840aed'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:40.036561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd75f0fa95c5497797f65dbfdb840aed'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:40.037079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd75f0fa95c5497797f65dbfdb840aed'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:40.059611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd75f0fa95c5497797f65dbfdb840aed'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:40.071537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd75f0fa95c5497797f65dbfdb840aed'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:40.152994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 760/1507] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:45:39 2022] DELETE /identity/v3/users/bd75f0fa95c5497797f65dbfdb840aed => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:45:40.157693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:40.158087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:40.158408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:40.215027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:45:40.216274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:40.291199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:40.303897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 748/1508] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:45:40.314289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:40.315507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:40.415742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2316-7e8a-489c-84bd-0fa04f08d337 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:40.469772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:40.489167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:40.489810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:40.490087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:40.490353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:40.492058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:40.598044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:40.599435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feefa82-3500-4acb-b60f-a65d23751c66 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:40.618564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 761/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:45:41.101154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:45:41.106217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:45:41.114393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f525a-36ed-459f-b337-a5e6a4c5bfc0 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:45:41.210779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:45:41.211641 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:45:41.211943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:45:41.212226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] PATH_INFO: `/v3/projects/7c06e9df176147bba5ec3d39e269547f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:45:41.222068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c06e9df176147bba5ec3d39e269547f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:45:41.223097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:45:41.223097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:45:41.223097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:45:41.224340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:45:41.330606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c06e9df176147bba5ec3d39e269547f', 'request_id': 'req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:41.336668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c06e9df176147bba5ec3d39e269547f', 'request_id': 'req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:41.352489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c06e9df176147bba5ec3d39e269547f', 'request_id': 'req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:41.445356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] The token cache is being invalidate because project 7c06e9df176147bba5ec3d39e269547f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:45:41.445566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:41.446090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e2cb8c1-30a3-4258-b11a-81d5e9a323d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:45:41.447446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 749/1510] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:45:41 2022] DELETE /identity/v3/projects/7c06e9df176147bba5ec3d39e269547f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:45:50.616266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=62 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:45:51.443278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:32.267179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a615-1c21-4873-bc00-7b764d4cea46 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:32.267787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a615-1c21-4873-bc00-7b764d4cea46 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:32.267787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2a615-1c21-4873-bc00-7b764d4cea46 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:32.269139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:32.274896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728a41-64ae-4ff8-8ff7-d1b24e57c50a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:32.275360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728a41-64ae-4ff8-8ff7-d1b24e57c50a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:32.275463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728a41-64ae-4ff8-8ff7-d1b24e57c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:32.355798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-69728a41-64ae-4ff8-8ff7-d1b24e57c50a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:32.357143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-69728a41-64ae-4ff8-8ff7-d1b24e57c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:32.460601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:32.613102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2a615-1c21-4873-bc00-7b764d4cea46 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:32.615362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-22d2a615-1c21-4873-bc00-7b764d4cea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:32.733132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2a615-1c21-4873-bc00-7b764d4cea46 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:32.738565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7ccb9-d9b0-4c24-bf06-775ea89dd649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:32.739202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ccb9-d9b0-4c24-bf06-775ea89dd649 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:32.739484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ccb9-d9b0-4c24-bf06-775ea89dd649 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:32.739759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ccb9-d9b0-4c24-bf06-775ea89dd649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:32.748644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ccb9-d9b0-4c24-bf06-775ea89dd649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:32.750229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ccb9-d9b0-4c24-bf06-775ea89dd649 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:32.760314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 763/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:33.599767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca7273-4412-4e6f-b656-94a60e67469a None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:33.600390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca7273-4412-4e6f-b656-94a60e67469a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:33.600390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca7273-4412-4e6f-b656-94a60e67469a None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:33.601919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:33.606839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b788c1-62db-4e05-9ea5-61c6fcbfd0b6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:33.607270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b788c1-62db-4e05-9ea5-61c6fcbfd0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:33.607397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b788c1-62db-4e05-9ea5-61c6fcbfd0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:33.629133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-05b788c1-62db-4e05-9ea5-61c6fcbfd0b6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:33.630341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05b788c1-62db-4e05-9ea5-61c6fcbfd0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:33.639307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:33.793839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca7273-4412-4e6f-b656-94a60e67469a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:33.808863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca7273-4412-4e6f-b656-94a60e67469a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:33.814370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097f2fe-79d9-4b22-b78d-28d0577955c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:33.814999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f2fe-79d9-4b22-b78d-28d0577955c4 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:33.815280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f2fe-79d9-4b22-b78d-28d0577955c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:33.815552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097f2fe-79d9-4b22-b78d-28d0577955c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:33.823600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097f2fe-79d9-4b22-b78d-28d0577955c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:33.825247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097f2fe-79d9-4b22-b78d-28d0577955c4 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:33.834574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 752/1516] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:36.696686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f90e-134c-4da6-85a2-d243346ea0b4 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:36.697096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f90e-134c-4da6-85a2-d243346ea0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:36.697246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6f90e-134c-4da6-85a2-d243346ea0b4 None None] PATH_INFO: `/v3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:36.698580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 765/1517] 10.222.0.58 () {54 vars in 925 bytes} [Mon Jul 25 12:47:36 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:47:36.708615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010fd5-073b-4f55-898e-4bdfc0eae9d1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:36.709038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010fd5-073b-4f55-898e-4bdfc0eae9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:36.709154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57010fd5-073b-4f55-898e-4bdfc0eae9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:36.768642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-57010fd5-073b-4f55-898e-4bdfc0eae9d1 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:36.769807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-57010fd5-073b-4f55-898e-4bdfc0eae9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:36.786841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:36.841167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 753/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Mon Jul 25 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:41.473650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028ef8d-526f-4b6b-8ee5-3aec43634bda None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:41.474176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028ef8d-526f-4b6b-8ee5-3aec43634bda None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:41.474176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028ef8d-526f-4b6b-8ee5-3aec43634bda None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:41.475617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 766/1519] 10.222.0.45 () {54 vars in 961 bytes} [Mon Jul 25 12:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:41.480906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d44e-cf24-40a5-ae64-d7a0fa0e12f7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:41.481304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d44e-cf24-40a5-ae64-d7a0fa0e12f7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:41.481464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d44e-cf24-40a5-ae64-d7a0fa0e12f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:41.501438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2b47d44e-cf24-40a5-ae64-d7a0fa0e12f7 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:41.502638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2b47d44e-cf24-40a5-ae64-d7a0fa0e12f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:41.512358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 754/1520] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Jul 25 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:41.521032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028ef8d-526f-4b6b-8ee5-3aec43634bda None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:41.535501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028ef8d-526f-4b6b-8ee5-3aec43634bda None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:41.540749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b77bc1-0a9a-4234-a88a-c02f823a8e35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:41.545056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77bc1-0a9a-4234-a88a-c02f823a8e35 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:41.545056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77bc1-0a9a-4234-a88a-c02f823a8e35 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:41.545056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77bc1-0a9a-4234-a88a-c02f823a8e35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:41.551995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b77bc1-0a9a-4234-a88a-c02f823a8e35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:41.553993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b77bc1-0a9a-4234-a88a-c02f823a8e35 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:41.564443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 767/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:45.056497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f854c-4ccb-409a-8f27-668655f1db4c None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:45.057064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f854c-4ccb-409a-8f27-668655f1db4c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:45.057064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f854c-4ccb-409a-8f27-668655f1db4c None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:45.058436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:45.063212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce017674-3acb-4e12-98b8-53b10583e09c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:45.063683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce017674-3acb-4e12-98b8-53b10583e09c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:45.063791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce017674-3acb-4e12-98b8-53b10583e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:45.083156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ce017674-3acb-4e12-98b8-53b10583e09c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:45.084376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ce017674-3acb-4e12-98b8-53b10583e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:45.092325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:45.246442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f854c-4ccb-409a-8f27-668655f1db4c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:45.260652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f854c-4ccb-409a-8f27-668655f1db4c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:45.267249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5715-3888-47bb-93e4-2fadecc99c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:45.267249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5715-3888-47bb-93e4-2fadecc99c05 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:45.267249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5715-3888-47bb-93e4-2fadecc99c05 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:45.267249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5715-3888-47bb-93e4-2fadecc99c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:45.275281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5715-3888-47bb-93e4-2fadecc99c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:45.276884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5715-3888-47bb-93e4-2fadecc99c05 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:45.286149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 756/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:46.112896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399966d-eeb0-4432-9c29-231447c0d00d None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:46.113346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399966d-eeb0-4432-9c29-231447c0d00d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:46.113441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399966d-eeb0-4432-9c29-231447c0d00d None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:46.114852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 12:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:46.120582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6b6c-6402-49fe-b9ce-9106c0092a3b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:46.120979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6b6c-6402-49fe-b9ce-9106c0092a3b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:46.121146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6b6c-6402-49fe-b9ce-9106c0092a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:46.140613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-740e6b6c-6402-49fe-b9ce-9106c0092a3b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:46.141823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-740e6b6c-6402-49fe-b9ce-9106c0092a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:46.150012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 12:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:46.300937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399966d-eeb0-4432-9c29-231447c0d00d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:46.315346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399966d-eeb0-4432-9c29-231447c0d00d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:46.320979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a64a14-f5da-45b8-bbb2-0e5896df7319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:46.321610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a64a14-f5da-45b8-bbb2-0e5896df7319 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:46.321898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a64a14-f5da-45b8-bbb2-0e5896df7319 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:46.322174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a64a14-f5da-45b8-bbb2-0e5896df7319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:46.330255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a64a14-f5da-45b8-bbb2-0e5896df7319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:46.331832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a64a14-f5da-45b8-bbb2-0e5896df7319 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:46.341877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 770/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:50.059590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21844497-5160-46a9-a3f5-f753f850d1d2 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:50.060195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21844497-5160-46a9-a3f5-f753f850d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:50.060195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21844497-5160-46a9-a3f5-f753f850d1d2 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:50.061568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:50.066669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e6039-9579-435a-8d81-1ede9bd40fc3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:50.067110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e6039-9579-435a-8d81-1ede9bd40fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:50.067221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e6039-9579-435a-8d81-1ede9bd40fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:50.087780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1b5e6039-9579-435a-8d81-1ede9bd40fc3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:50.088996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1b5e6039-9579-435a-8d81-1ede9bd40fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:50.096876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:50.172377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21844497-5160-46a9-a3f5-f753f850d1d2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:50.174065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-21844497-5160-46a9-a3f5-f753f850d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:50.251302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21844497-5160-46a9-a3f5-f753f850d1d2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:50.254809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afe9e9-5e5f-4cfc-bb8e-84d522031496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:50.255443 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afe9e9-5e5f-4cfc-bb8e-84d522031496 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:50.255722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afe9e9-5e5f-4cfc-bb8e-84d522031496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:50.256025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afe9e9-5e5f-4cfc-bb8e-84d522031496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:50.265450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afe9e9-5e5f-4cfc-bb8e-84d522031496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:50.266861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afe9e9-5e5f-4cfc-bb8e-84d522031496 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:50.276131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 759/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:52.274502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64db536-bb39-4b36-a24f-4a290ab59528 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:52.275076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64db536-bb39-4b36-a24f-4a290ab59528 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:52.275076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64db536-bb39-4b36-a24f-4a290ab59528 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:52.276528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:52.281753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904739d-e980-427b-b43d-c0d060245cb7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:52.282184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904739d-e980-427b-b43d-c0d060245cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:52.282316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904739d-e980-427b-b43d-c0d060245cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:52.301524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3904739d-e980-427b-b43d-c0d060245cb7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:52.302749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3904739d-e980-427b-b43d-c0d060245cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:52.311108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:52.346451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64db536-bb39-4b36-a24f-4a290ab59528 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:52.357275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64db536-bb39-4b36-a24f-4a290ab59528 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:52.360849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9a02-ff00-48b2-aff6-3a3a6e7dcf7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:52.361479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9a02-ff00-48b2-aff6-3a3a6e7dcf7e service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:52.361758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9a02-ff00-48b2-aff6-3a3a6e7dcf7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:52.362026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9a02-ff00-48b2-aff6-3a3a6e7dcf7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:52.371619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9a02-ff00-48b2-aff6-3a3a6e7dcf7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:52.373077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9a02-ff00-48b2-aff6-3a3a6e7dcf7e service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:52.383175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 773/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:56.124245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8b86-8b48-4984-9aa8-0dc81e85f2cd None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:56.124861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8b86-8b48-4984-9aa8-0dc81e85f2cd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:56.124861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f8b86-8b48-4984-9aa8-0dc81e85f2cd None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:56.126168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:56.131530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77424aed-44cc-43b0-8014-3fb586497491 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:56.132040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77424aed-44cc-43b0-8014-3fb586497491 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:56.132191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77424aed-44cc-43b0-8014-3fb586497491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:56.151615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-77424aed-44cc-43b0-8014-3fb586497491 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:56.161836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-77424aed-44cc-43b0-8014-3fb586497491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:56.161836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:56.468063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f8b86-8b48-4984-9aa8-0dc81e85f2cd None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:56.469762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-297f8b86-8b48-4984-9aa8-0dc81e85f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:56.535276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:47:56.548955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f8b86-8b48-4984-9aa8-0dc81e85f2cd None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:56.552625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f17d4-2471-43e9-8a94-889312ef9316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:56.553267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f17d4-2471-43e9-8a94-889312ef9316 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:56.554285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f17d4-2471-43e9-8a94-889312ef9316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:56.554515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f17d4-2471-43e9-8a94-889312ef9316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:56.563394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f17d4-2471-43e9-8a94-889312ef9316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:56.564949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f17d4-2471-43e9-8a94-889312ef9316 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:56.574774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 762/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:47:58.589074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a959c7-c8b2-4360-ae9b-781261dec363 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:58.589644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a959c7-c8b2-4360-ae9b-781261dec363 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:58.589644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a959c7-c8b2-4360-ae9b-781261dec363 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:58.590983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 12:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:47:58.596074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85b298-4225-41f7-bb49-433741a2848a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:58.596460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85b298-4225-41f7-bb49-433741a2848a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:58.596635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85b298-4225-41f7-bb49-433741a2848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:58.615677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6e85b298-4225-41f7-bb49-433741a2848a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:47:58.616915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6e85b298-4225-41f7-bb49-433741a2848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:58.625055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:47:58.926580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a959c7-c8b2-4360-ae9b-781261dec363 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:47:58.928794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b8a959c7-c8b2-4360-ae9b-781261dec363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:47:58.941564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a959c7-c8b2-4360-ae9b-781261dec363 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:47:58.945652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3e6b0-646a-4ea8-aed7-e7714c0ab73d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:47:58.946281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e6b0-646a-4ea8-aed7-e7714c0ab73d service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:47:58.946585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e6b0-646a-4ea8-aed7-e7714c0ab73d service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:47:58.946854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3e6b0-646a-4ea8-aed7-e7714c0ab73d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:47:58.956150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e6b0-646a-4ea8-aed7-e7714c0ab73d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:47:58.957573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3e6b0-646a-4ea8-aed7-e7714c0ab73d service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:47:58.967377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 776/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:48:08.610933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=11 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:48:08.963219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:36.998099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:36.999406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:36.999940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.026896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.028207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.043142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 764/1540] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.053029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.053639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.053639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.092080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.093321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.106028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 777/1541] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.110541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.126392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9415fb-e3db-4599-a01b-fbdac49b731c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.135825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.137136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.137431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.137714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.138463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:37.138774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.140452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7f60c-8ec0-49b6-8e24-4552b305070b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.158693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 765/1542] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:37.167096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.178344 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddba6f3-9900-4bbb-a330-561933c65f47 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.189811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.190484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.190769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.191045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.191744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.194166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.300651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfd3a2-ce5e-48c0-9d6b-bae568a17084 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.300855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfd3a2-ce5e-48c0-9d6b-bae568a17084 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.301142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfd3a2-ce5e-48c0-9d6b-bae568a17084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.324538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 778/1543] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:37.328643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.334915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b1dfd3a2-ce5e-48c0-9d6b-bae568a17084 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.343717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b1dfd3a2-ce5e-48c0-9d6b-bae568a17084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.428886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd303f-a31e-4ba1-8490-de3b32722981 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.436828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 766/1544] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:49:37.438446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be02e5-d966-44eb-ae5c-7224b47c5b92 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.438852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be02e5-d966-44eb-ae5c-7224b47c5b92 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.439167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be02e5-d966-44eb-ae5c-7224b47c5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.441698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.442899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.443184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.443460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.444253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.445398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:37.445398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:49:37.445398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:49:37.447225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b8084-7ef8-4885-99dd-90a9c4478e45 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.477037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d7be02e5-d966-44eb-ae5c-7224b47c5b92 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.481632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d7be02e5-d966-44eb-ae5c-7224b47c5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.495541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 767/1545] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.498709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6d2d3-078b-4204-a7f1-4125009b9fd5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.499007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6d2d3-078b-4204-a7f1-4125009b9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.499287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6d2d3-078b-4204-a7f1-4125009b9fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.530662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-eeb6d2d3-078b-4204-a7f1-4125009b9fd5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.532535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-eeb6d2d3-078b-4204-a7f1-4125009b9fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.541219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 768/1546] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.542482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061f5fb-9754-41ab-ad28-e74ea8b62b87 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.542779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061f5fb-9754-41ab-ad28-e74ea8b62b87 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.543226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061f5fb-9754-41ab-ad28-e74ea8b62b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.564634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c061f5fb-9754-41ab-ad28-e74ea8b62b87 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.565748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c061f5fb-9754-41ab-ad28-e74ea8b62b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.574853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 769/1547] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.576975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7b5c-d604-470a-a32d-1934ca072db2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.577263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7b5c-d604-470a-a32d-1934ca072db2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.577692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7b5c-d604-470a-a32d-1934ca072db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.580841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 779/1548] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:49:37.581841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb0da-74e8-478e-bf3f-f61fe24e2ace None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.582387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb0da-74e8-478e-bf3f-f61fe24e2ace None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.582678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb0da-74e8-478e-bf3f-f61fe24e2ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.599790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b99b7b5c-d604-470a-a32d-1934ca072db2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.601310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b99b7b5c-d604-470a-a32d-1934ca072db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.604259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-87deb0da-74e8-478e-bf3f-f61fe24e2ace None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.605527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-87deb0da-74e8-478e-bf3f-f61fe24e2ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.611414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 770/1549] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.613506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.613791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.614101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.631554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 780/1550] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.631554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172861-772a-4b17-b8a0-2eb50a6358b4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.631554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172861-772a-4b17-b8a0-2eb50a6358b4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.631554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172861-772a-4b17-b8a0-2eb50a6358b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.639696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.642276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.651166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 771/1551] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.651733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.660315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1d172861-772a-4b17-b8a0-2eb50a6358b4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.662477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1d172861-772a-4b17-b8a0-2eb50a6358b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.663005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774232e-0e75-4324-bc65-7d7376bea8b4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.667815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.668525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.668813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.669093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.669831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:37.670145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.671777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe32418-afc2-422b-b3f1-940d4111e2fe admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.671909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 781/1552] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.680128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.680128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.680128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.694370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 772/1553] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:37.695706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f355210-6a4f-4ec6-ad78-6c7c2bf1ae0b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.696096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f355210-6a4f-4ec6-ad78-6c7c2bf1ae0b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.696324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f355210-6a4f-4ec6-ad78-6c7c2bf1ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.709975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.715082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.719496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5f355210-6a4f-4ec6-ad78-6c7c2bf1ae0b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.720477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 782/1554] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.720937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5f355210-6a4f-4ec6-ad78-6c7c2bf1ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.721557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.732219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 773/1555] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.733555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.733910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.734244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.739455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362d8b4-e343-4385-a786-5041d02896c5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.745616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af76295-1f98-4b1b-a7f2-fc00e4eb436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.748395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af76295-1f98-4b1b-a7f2-fc00e4eb436b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.748395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af76295-1f98-4b1b-a7f2-fc00e4eb436b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.748395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af76295-1f98-4b1b-a7f2-fc00e4eb436b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.748395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af76295-1f98-4b1b-a7f2-fc00e4eb436b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.750027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af76295-1f98-4b1b-a7f2-fc00e4eb436b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.755105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.756580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.765126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 783/1556] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:37.765126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e039-2d73-44e4-a2db-3e02b4c3ad1f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.765126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e039-2d73-44e4-a2db-3e02b4c3ad1f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.765126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029e039-2d73-44e4-a2db-3e02b4c3ad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.770170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 774/1557] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.772150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.784760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36398b3-253d-4dab-a433-45fd1665688e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.789730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4029e039-2d73-44e4-a2db-3e02b4c3ad1f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.789730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4029e039-2d73-44e4-a2db-3e02b4c3ad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.791402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.792276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.792649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.793054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.794024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:37.794506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.796745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.798030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 784/1558] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.799305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d64a-fe47-41a4-a68e-f8882a757507 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.799595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d64a-fe47-41a4-a68e-f8882a757507 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.799874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d64a-fe47-41a4-a68e-f8882a757507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.812659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 775/1559] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:37.818476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.825226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14748147-073d-4f7a-9b0f-50d0080a5f27 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.827188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dba2d64a-fe47-41a4-a68e-f8882a757507 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.828586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dba2d64a-fe47-41a4-a68e-f8882a757507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.830626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.831353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.831638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.831938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.832651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.834742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:37.834742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:49:37.834742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:49:37.835991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.837840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 785/1560] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.841786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.841786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.841786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.861970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:37.863194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:37.871664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 786/1561] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:37.872569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.883448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda85d8-227c-4629-a8b8-a944dd008eec None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.888541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.889201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.889485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.889762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.890495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:37.890805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.891818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:37.891818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:49:37.891818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:49:37.892736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.905359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 787/1562] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:37.906178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.919016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfc272-1c3c-40f1-8157-0c3fc7414f39 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.923776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:37.926287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:37.926287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:37.926287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:37.926287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:37.928648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:37.943655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 788/1563] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:37.943655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:37.953794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf9198-0bd4-4a70-959a-e20deb403139 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:37.955512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 776/1564] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:37.956993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.002214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:38.028290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.029032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.029324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.029617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.030342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:38.030654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.032334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.039437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:38.046463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 789/1565] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:38.047774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.055668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693ed6-87f9-428f-8eed-1719479c3f7b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.060304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.060961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.061239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.061535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.062254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:38.062556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.064037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e989e8c-506f-43c0-ba3c-e55f4b0357b0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.064532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.070863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.071456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.071745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.072055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.072749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.074644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.076324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 777/1566] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:38.077144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.088884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fab56b-84f3-4c94-afe4-07ed3c0a1e76 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.093823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.094484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.094774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.095045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.095770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:38.096113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.097782 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.112276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 778/1567] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:38.113431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.127362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cb6b0-80aa-4ada-bec6-d045a0578a69 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.132463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.133423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.137894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.137894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.137894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:38.137894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.137894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.149210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 779/1568] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:38.150191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.160424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578d302-7368-4a2a-8a7d-f6a2818c784c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.165890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.166610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.167455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.167455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.167946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.169860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.199123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 790/1569] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.201040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.255624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 780/1570] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.259678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.277931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6b2d0-ad69-4c03-a4f5-9fd163f3631a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.332642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556fba-9059-49b9-909f-9c402aa02f01 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.338214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.338881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.339167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.339447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.340171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.342020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.342158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.343062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.343302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.343531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] PATH_INFO: `/v3/projects/9a4fc9f096e9451a84c690cb68ea51c6/users/acf448f841d9464ba85cd6062904fde5/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.361702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4fc9f096e9451a84c690cb68ea51c6, user_id=acf448f841d9464ba85cd6062904fde5, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.364484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.474864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 781/1571] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.474864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.482305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c08a-4cc6-4979-adc2-b3ce12b3aa9f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.486950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.487649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.487940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.488234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.488921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.490859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.505258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 791/1572] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:38 2022] PUT /identity/v3/projects/9a4fc9f096e9451a84c690cb68ea51c6/users/acf448f841d9464ba85cd6062904fde5/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:38.506094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.549422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:38.570252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55457f7-40fb-4c96-bc1a-dc54fff56a5a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.578348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.579514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.580089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.580599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.581882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.585856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.602379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 782/1573] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/projects => generated 405 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.603318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.671668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694d582-46e2-4f47-b76e-03136d7b5bd4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.676571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.677233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.683298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.683298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.683298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.683298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.685727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:38.713026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 792/1574] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.713866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.776619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d9b80-5453-4036-95a2-cb4d035812f4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.781289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.781936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.782215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.782483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.783174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.785097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.798963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 783/1575] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.798963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.857858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd8e7a-4189-42cb-adaf-40be4124fb42 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:38.862517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:38.863185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:38.863468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:38.863741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:38.864529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:38.866560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:38.931541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 793/1576] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/projects => generated 385 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.931541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.974088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 784/1577] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:38.974948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:38.987164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19745d50-b6f2-48e9-b886-e25a0cc3727c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.006630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c85c0-0280-493f-88bc-36783ae3835f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.011458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.013016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.013016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.013016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.013501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.015485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.055124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bb849-eb9d-40f3-8500-360edbfa6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.055804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb849-eb9d-40f3-8500-360edbfa6a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.056122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb849-eb9d-40f3-8500-360edbfa6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.056401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb849-eb9d-40f3-8500-360edbfa6a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.057258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bb849-eb9d-40f3-8500-360edbfa6a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.059120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bb849-eb9d-40f3-8500-360edbfa6a83 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.070250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 785/1578] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.071773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.077412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.077412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.101621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] MFA Rules not processed for user `acf448f841d9464ba85cd6062904fde5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:39.103042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:39.107218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 794/1579] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:38 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.107218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.116605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6cc47-22c4-4dc7-800d-1b30d1683c72 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.121889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.122555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.122837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.123113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.123805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.125760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.171771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:39.175544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 786/1580] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:39.176401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.187416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154883a-8e35-4387-a947-00dd7f62c481 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.192038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.194639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.194639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.194639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.194639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.196639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.225558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 795/1581] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.226473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.235985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339bb17-1742-4ae1-9382-023a54624e90 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.241414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.242056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.242594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.242870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.243551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.245500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.311376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 787/1582] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.312503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.322677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c862a-0b0e-4329-9d55-d9d6c06be0fb admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.327329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.328007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.328293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.328567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.329241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.331324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.343653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 796/1583] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.347007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.351737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:39.355793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc71a1-9135-4502-9ec0-fef7ada0781e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.360851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.361497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.361807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.362080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.362794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.365140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.375647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 797/1584] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.376380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.385974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e6b7-70af-4408-909c-67bd763311be admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.390502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.392873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.392873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.392873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.392873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.393913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.403862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 798/1585] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.404680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.415290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef166615-3158-425b-ac9b-d3ed70251696 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.427364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 788/1586] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.427364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.427607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.427607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.427607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.427607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.427903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.427903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.429654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f736bf-86a7-4482-96b6-a1fdc743f77d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.434447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.435255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.435546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.435826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.436167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 799/1587] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.436560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.436979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.438569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.446815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce029c7-909c-43df-8325-4ffda4c41f70 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.451415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.452080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.452367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.452647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.453365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.454959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.464921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 800/1588] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.465714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.475428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913334-0b62-41f1-8955-c36f2d2471a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.479992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.480628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.480911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.481187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.481885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.483473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.494546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 801/1589] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.495324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.504492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cdda1-b68d-436f-b54d-5db9acf7de70 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.509329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.509940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.510230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.510510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.511204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.512793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.523311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 802/1590] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.524127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.533926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeb3cd-7463-426e-a0e3-18a9078203c1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.539129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.539747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.540063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.540406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.541144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.542711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.553047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 803/1591] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.553798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.563076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b22c05-334d-4ed7-a641-a529595f4f7d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.567973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.568828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.576830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.576830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] PATH_INFO: `/v3/projects/ccaa1a16a5f649fe8a5898edbc9cbadf/users/c548901a69404c2baf8392e79f35c2b3/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.577089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 789/1592] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.577089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.585690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaa1a16a5f649fe8a5898edbc9cbadf, user_id=c548901a69404c2baf8392e79f35c2b3, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.588436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.635584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bea1c3-ecd7-4b88-92ec-f6e519875bff admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.640205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.640874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.645628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.645628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.645628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.645628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.654098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 790/1593] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.654890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.665177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b1275-edd0-4b4e-9b59-8334acbdf411 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.669731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.670356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.670639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.670914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.671621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.673224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.676565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 804/1594] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:39 2022] PUT /identity/v3/projects/ccaa1a16a5f649fe8a5898edbc9cbadf/users/c548901a69404c2baf8392e79f35c2b3/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:39.680976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.690018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 791/1595] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.690018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.700533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f92e7-114e-4ff6-a470-618f252a6691 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.749494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e84372-dddb-40d4-9357-8cd352ff9b09 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.754100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.754810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.755088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.755425 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.756307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.757896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.760631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.761316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.761599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.761876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.762638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.764516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.771428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 805/1596] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.771428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.776093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 792/1597] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.777017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.785151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c173-7a06-498e-9b71-9889711be2b1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.788027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909d442-a2cf-4ea5-aac5-d85e9d192f1c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.790735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.791393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.791678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.791980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.792679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.792818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.793675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.793954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.794225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] PATH_INFO: `/v3/projects/905222b11d434703848025ac706603ba/users/93c4b63d65304186ba0ba06a6a31f3f3/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.794427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.806798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 806/1598] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.807234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.810005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=905222b11d434703848025ac706603ba, user_id=93c4b63d65304186ba0ba06a6a31f3f3, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.810983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:39.810983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:49:39.810983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:49:39.812973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.817087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66349016-3ba2-40a2-b62a-589360d0a93e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.821919 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2488-d0b8-4d7f-92a3-f6cd8483d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.822565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2488-d0b8-4d7f-92a3-f6cd8483d275 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.822874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2488-d0b8-4d7f-92a3-f6cd8483d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.823154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2488-d0b8-4d7f-92a3-f6cd8483d275 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.823936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2488-d0b8-4d7f-92a3-f6cd8483d275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.825869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2488-d0b8-4d7f-92a3-f6cd8483d275 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.883307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:39.891787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 793/1599] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:39 2022] PUT /identity/v3/projects/905222b11d434703848025ac706603ba/users/93c4b63d65304186ba0ba06a6a31f3f3/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:39.891787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.915246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 807/1600] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:39.916722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.917006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.924210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.936700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:39.937904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:39.957227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936048dd-2a0e-4283-817d-28e4a93fa573 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.963232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.963898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.964422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.964563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:39.964663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:39.965206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:39.966814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:39.981129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 794/1601] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:39.981129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:39.990970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0570e-462b-47f4-bf72-c1e98834c514 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:39.995970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:39.996845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:39.997126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:39.997427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] PATH_INFO: `/v3/projects/c54a871cd2e24c54a2195ff7449a3f46/users/be32c4b0a5714e60ae19e3538652cc60/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.002816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 808/1602] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.003607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.013370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54a871cd2e24c54a2195ff7449a3f46, user_id=be32c4b0a5714e60ae19e3538652cc60, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.013588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb26c-ff79-4d7a-b3b9-f751ee526e2e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.016170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.018351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.019272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.019551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.019820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] PATH_INFO: `/v3/projects/7c4f5bb8021741e489822d1377cb2ee0/users/878ff6767df742ce8437a1a1d492a29e/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.036502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4f5bb8021741e489822d1377cb2ee0, user_id=878ff6767df742ce8437a1a1d492a29e, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.039465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.097888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 795/1603] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:39 2022] PUT /identity/v3/projects/c54a871cd2e24c54a2195ff7449a3f46/users/be32c4b0a5714e60ae19e3538652cc60/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:40.099287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.126485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 809/1604] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:40 2022] PUT /identity/v3/projects/7c4f5bb8021741e489822d1377cb2ee0/users/878ff6767df742ce8437a1a1d492a29e/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:40.127165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.165638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a864ad-9991-4ce0-970c-9a2af0649bdc admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.198460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fec4-18b1-4d46-838a-8d84fcd5cccf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.203131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a8ce1-0c8d-4114-ac53-e24f76256a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.204084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8ce1-0c8d-4114-ac53-e24f76256a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.204381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8ce1-0c8d-4114-ac53-e24f76256a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.204647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a8ce1-0c8d-4114-ac53-e24f76256a71 admin admin] PATH_INFO: `/v3/projects/dce28c0477dd488da533a8d7553bba88/users/ba34e08ed3594bc38a17abf6906b9b0b/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.219858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a8ce1-0c8d-4114-ac53-e24f76256a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce28c0477dd488da533a8d7553bba88, user_id=ba34e08ed3594bc38a17abf6906b9b0b, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.222579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a8ce1-0c8d-4114-ac53-e24f76256a71 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.223509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.224667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.224954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.225226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] PATH_INFO: `/v3/projects/4b0d563f94cf41f39086f16890e6752f/users/d43291d867134ac7b4ff20df86c94cf1/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.239902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0d563f94cf41f39086f16890e6752f, user_id=d43291d867134ac7b4ff20df86c94cf1, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.242820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.293706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 810/1605] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:40 2022] PUT /identity/v3/projects/dce28c0477dd488da533a8d7553bba88/users/ba34e08ed3594bc38a17abf6906b9b0b/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:40.295004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.295294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.295571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.314097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:40.315350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.322490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 796/1606] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:40 2022] PUT /identity/v3/projects/4b0d563f94cf41f39086f16890e6752f/users/d43291d867134ac7b4ff20df86c94cf1/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:40.323414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.338026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:40.377830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 811/1607] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.378808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.392310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c92c51-27e5-4826-aa80-db11d061aadf None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.398023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bd2ed-8347-4660-9349-580aad81f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.398918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bd2ed-8347-4660-9349-580aad81f5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.399203 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bd2ed-8347-4660-9349-580aad81f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.399483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bd2ed-8347-4660-9349-580aad81f5f9 admin admin] PATH_INFO: `/v3/projects/391c01de1d2b41f38ba50166a514848e/users/7e57544908594b31a68a35a3ad9ee840/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.400699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7109523-e629-4642-9b1c-418726420b9e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.405985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.406948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.407571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.408474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.409012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.411295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.415992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bd2ed-8347-4660-9349-580aad81f5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=391c01de1d2b41f38ba50166a514848e, user_id=7e57544908594b31a68a35a3ad9ee840, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.418743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bd2ed-8347-4660-9349-580aad81f5f9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.422713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 797/1608] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:40.423569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.483634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a7931-bd80-4cc8-b7f0-e496972dc9b3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.487531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c4d5b-1dfc-4179-a56b-5e9fa8f4b123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.488215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c4d5b-1dfc-4179-a56b-5e9fa8f4b123 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.488499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c4d5b-1dfc-4179-a56b-5e9fa8f4b123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.497545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c4d5b-1dfc-4179-a56b-5e9fa8f4b123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.499276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c4d5b-1dfc-4179-a56b-5e9fa8f4b123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.500760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c4d5b-1dfc-4179-a56b-5e9fa8f4b123 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.511330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 798/1609] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:40.512738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99534da-46e8-4129-942e-e2c5fab20c4c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.513049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99534da-46e8-4129-942e-e2c5fab20c4c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.513303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99534da-46e8-4129-942e-e2c5fab20c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.534172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 812/1610] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:40 2022] PUT /identity/v3/projects/391c01de1d2b41f38ba50166a514848e/users/7e57544908594b31a68a35a3ad9ee840/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:40.537539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42b94-ac89-4b9f-94ae-f1e2e1de37de None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.537539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42b94-ac89-4b9f-94ae-f1e2e1de37de None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.537539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e42b94-ac89-4b9f-94ae-f1e2e1de37de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.545478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d99534da-46e8-4129-942e-e2c5fab20c4c None None] MFA Rules not processed for user `be32c4b0a5714e60ae19e3538652cc60`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:40.546711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d99534da-46e8-4129-942e-e2c5fab20c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.550421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:40.565906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-39e42b94-ac89-4b9f-94ae-f1e2e1de37de None None] MFA Rules not processed for user `878ff6767df742ce8437a1a1d492a29e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:40.567806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-39e42b94-ac89-4b9f-94ae-f1e2e1de37de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.613305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 799/1611] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.615362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.615737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.616114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.637152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:40.638490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.643382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 813/1612] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.643382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.643382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.643382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.674948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:40.679159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] MFA Rules not processed for user `d43291d867134ac7b4ff20df86c94cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:40.680420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.722824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 800/1613] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.724376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.725889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.759000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 814/1614] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.759861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.773592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bfef8-ea9b-4002-b437-ccc68a9a0bc3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.778720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.781584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.781584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.781584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] PATH_INFO: `/v3/projects/8365794f74244e04a20a791df588b437/users/7398b2629a4e4ff5ae39d95e972e40d3/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.792009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb7696-e876-435e-9ae8-625652d844ee None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.795327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8365794f74244e04a20a791df588b437, user_id=7398b2629a4e4ff5ae39d95e972e40d3, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.796123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c69b4-75b6-4437-a50e-6ab9e3dde90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.796805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c69b4-75b6-4437-a50e-6ab9e3dde90d service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.797093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c69b4-75b6-4437-a50e-6ab9e3dde90d service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.797374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c69b4-75b6-4437-a50e-6ab9e3dde90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.798393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.815859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c69b4-75b6-4437-a50e-6ab9e3dde90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.815859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c69b4-75b6-4437-a50e-6ab9e3dde90d service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.820849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 801/1615] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:40.822284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.822609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.822868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.855107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] MFA Rules not processed for user `7e57544908594b31a68a35a3ad9ee840`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:40.856605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:40.878131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 815/1616] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:40 2022] PUT /identity/v3/projects/8365794f74244e04a20a791df588b437/users/7398b2629a4e4ff5ae39d95e972e40d3/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:40.879142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.947973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 802/1617] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:40.948936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:40.953191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e1db9-73c8-45c1-98e2-d57a5627b2e8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.962252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.963136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b35152-455d-4b2f-85a5-016d5b29b547 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:40.963523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.963815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.964138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.965110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.967130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.968101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:40.968775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:40.969064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:40.969434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:40.970375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:40.972325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:40.974051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:41.121817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 816/1618] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:41.123099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.127392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 803/1619] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:40 2022] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:41.127392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.210267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:41.215364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4e33e-8317-40b9-ba97-f8921a555cf0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.230259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847a12c-43fd-41e9-a357-88f8824cdd64 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.237100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.238152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.238464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.238742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.241004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.243294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.284389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.285239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.285595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.285963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.296255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.297830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.307780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 817/1620] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:41.312586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.321217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adb69a-aa0b-4701-8445-d99953cafe1d service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.326674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5649b7d-f3bf-4cb1-a40d-c706d82edcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.327512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5649b7d-f3bf-4cb1-a40d-c706d82edcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.327792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5649b7d-f3bf-4cb1-a40d-c706d82edcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.328322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5649b7d-f3bf-4cb1-a40d-c706d82edcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.328826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5649b7d-f3bf-4cb1-a40d-c706d82edcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.330428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5649b7d-f3bf-4cb1-a40d-c706d82edcc8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.342530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 818/1621] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:41.344189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acb3d5-c5e2-4079-9ce7-9878c54312a6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.344528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acb3d5-c5e2-4079-9ce7-9878c54312a6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.344812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acb3d5-c5e2-4079-9ce7-9878c54312a6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.358317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 819/1622] 10.222.0.45 () {54 vars in 962 bytes} [Mon Jul 25 12:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:49:41.358458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 804/1623] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:41 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:41.358458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.358653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acb3d5-c5e2-4079-9ce7-9878c54312a6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.439973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acb3d5-c5e2-4079-9ce7-9878c54312a6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.445751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.446444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.446719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.447638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.448381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.450538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.453218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ee6c2-a02b-4a8e-8c4a-ea57a97acc90 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.458744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009471-92fc-4351-9850-5980ef89c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.459564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009471-92fc-4351-9850-5980ef89c2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.460028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009471-92fc-4351-9850-5980ef89c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.460169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009471-92fc-4351-9850-5980ef89c2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.461412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad009471-92fc-4351-9850-5980ef89c2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.462941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad009471-92fc-4351-9850-5980ef89c2e7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.612291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 805/1624] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:41 2022] POST /identity/v3/users => generated 308 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:41.613702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.614236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.614575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.620767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 820/1625] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:41 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:41.620767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.630280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ebf8-cf88-47f4-9e29-35aeb99d09d3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.634958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.635844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.636208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.636520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] PATH_INFO: `/v3/projects/8365794f74244e04a20a791df588b437/users/7398b2629a4e4ff5ae39d95e972e40d3/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.638557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8365794f74244e04a20a791df588b437, user_id=7398b2629a4e4ff5ae39d95e972e40d3, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.641227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.660043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 821/1626] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:41 2022] PUT /identity/v3/projects/8365794f74244e04a20a791df588b437/users/7398b2629a4e4ff5ae39d95e972e40d3/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:41.662545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.663581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:41.665002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:41.678543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:41.739055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb543646-4284-49a9-9914-6c3ebbf57cdd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.744976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.745715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.746143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.746469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.746785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 806/1627] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Jul 25 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:41.747365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.747907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.749504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.759796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960246f7-8d56-47a6-bfa9-f30be61f31e3 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.765480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.766250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.766478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.766768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.767486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.769129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.780482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 807/1628] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:41.781316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.791805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456c4d7-4c09-4383-969e-c0a46cacda27 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.804907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcaaf-66a2-4c91-ab48-dc160c7a90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.807950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcaaf-66a2-4c91-ab48-dc160c7a90b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.807950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcaaf-66a2-4c91-ab48-dc160c7a90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.807950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcaaf-66a2-4c91-ab48-dc160c7a90b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.808822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dcaaf-66a2-4c91-ab48-dc160c7a90b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:41.810509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dcaaf-66a2-4c91-ab48-dc160c7a90b7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:41.823682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 808/1629] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:41.825355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.825645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.826050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.861921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] MFA Rules not processed for user `7398b2629a4e4ff5ae39d95e972e40d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:41.863366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:41.904002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 822/1630] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:41 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:41.906171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.921127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332372a-a873-4ef7-baf5-531a3d4bf46e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.927393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.928157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.928512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.928795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:41.946911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:41.954973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 809/1631] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:41.954973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:41.965554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaa064-ddc9-43c5-8856-cbe8a72b797a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:41.976558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:41.977608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:41.978889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:41.978889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] PATH_INFO: `/v3/projects/18f9fb888d4944868ba02e79e1909036/users/d566460db5e848828965adc580332fc2/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.013143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f9fb888d4944868ba02e79e1909036, user_id=d566460db5e848828965adc580332fc2, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.016776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.021856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.023536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.036914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 823/1632] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:42.037567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.058117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f2af8-7ac2-40e2-ac7e-7b72ce662bd3 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.064277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.065554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.065914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.066263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] PATH_INFO: `/v3/projects/c9217d8bb98145aba0316cade5e47145/users/18ae4716dd5041cc973f7eb0077f88b8/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.097149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9217d8bb98145aba0316cade5e47145, user_id=18ae4716dd5041cc973f7eb0077f88b8, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.101102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.123334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 810/1633] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:41 2022] PUT /identity/v3/projects/18f9fb888d4944868ba02e79e1909036/users/d566460db5e848828965adc580332fc2/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:42.123334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.212690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 824/1634] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:42 2022] PUT /identity/v3/projects/c9217d8bb98145aba0316cade5e47145/users/18ae4716dd5041cc973f7eb0077f88b8/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:42.212690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.232980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67241f47-1914-4ae9-ab3c-95d6fc4132b3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.311767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04723fd7-b102-471a-b7ac-8a73aff3ecac admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.313771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.314714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.314998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.315273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.316254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.318931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.327944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.329032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.329607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.330130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.332564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 811/1635] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:42.333818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.346070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e371b62-7d69-4e0c-bd10-ba6d7fe83202 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.353759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.354441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.354722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.355235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.356003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.357946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.377415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 812/1636] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:42.378760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.391902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07450e1-6f3f-4ff5-aee9-af2d7a810d95 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.404108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:42.404896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.406766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.408069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.428622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.428622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.428622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.443898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.446616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.449687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 813/1637] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:42.452871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.463678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 825/1638] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:42.463678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.476410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b136c11-2718-4619-9464-96b470bc09c6 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.482306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907216d-4a68-46bf-9cae-414f69d301cf admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.482486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdb371-9c2a-49b7-8446-ac14a14aba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.483578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb371-9c2a-49b7-8446-ac14a14aba48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.484012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb371-9c2a-49b7-8446-ac14a14aba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.484386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb371-9c2a-49b7-8446-ac14a14aba48 admin admin] PATH_INFO: `/v3/projects/18f9fb888d4944868ba02e79e1909036/users/d566460db5e848828965adc580332fc2/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.486744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdb371-9c2a-49b7-8446-ac14a14aba48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f9fb888d4944868ba02e79e1909036, user_id=d566460db5e848828965adc580332fc2, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.490166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffdb371-9c2a-49b7-8446-ac14a14aba48 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.495818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f9f15-a00d-4679-9e38-c55dc730c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.498325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9f15-a00d-4679-9e38-c55dc730c223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.500545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9f15-a00d-4679-9e38-c55dc730c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.500912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9f15-a00d-4679-9e38-c55dc730c223 admin admin] PATH_INFO: `/v3/projects/0a2a03de82be4b7092e241b5514adeb3/users/ac670f4da4254ee382600a323ee44c90/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.505972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 826/1639] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:42 2022] PUT /identity/v3/projects/18f9fb888d4944868ba02e79e1909036/users/d566460db5e848828965adc580332fc2/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:42.509517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549487-88cd-4784-805e-b55f636f378c None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.509517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549487-88cd-4784-805e-b55f636f378c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.509517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549487-88cd-4784-805e-b55f636f378c None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.510465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 827/1640] 10.222.0.45 () {54 vars in 912 bytes} [Mon Jul 25 12:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:49:42.511746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549487-88cd-4784-805e-b55f636f378c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.553877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9f15-a00d-4679-9e38-c55dc730c223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2a03de82be4b7092e241b5514adeb3, user_id=ac670f4da4254ee382600a323ee44c90, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.557885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9f15-a00d-4679-9e38-c55dc730c223 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.615040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549487-88cd-4784-805e-b55f636f378c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.620647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c99129-d6a7-4d05-97f1-9220ea0df9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.621616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c99129-d6a7-4d05-97f1-9220ea0df9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.622004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c99129-d6a7-4d05-97f1-9220ea0df9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.622285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c99129-d6a7-4d05-97f1-9220ea0df9b5 admin admin] PATH_INFO: `/v3/projects/c9217d8bb98145aba0316cade5e47145/users/18ae4716dd5041cc973f7eb0077f88b8/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.624397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c99129-d6a7-4d05-97f1-9220ea0df9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9217d8bb98145aba0316cade5e47145, user_id=18ae4716dd5041cc973f7eb0077f88b8, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.627089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c99129-d6a7-4d05-97f1-9220ea0df9b5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.637873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 828/1641] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:42 2022] PUT /identity/v3/projects/c9217d8bb98145aba0316cade5e47145/users/18ae4716dd5041cc973f7eb0077f88b8/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:42.639092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee784-977b-4f2f-855c-317cea317abd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.639383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee784-977b-4f2f-855c-317cea317abd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.639662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ee784-977b-4f2f-855c-317cea317abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.668614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c13ee784-977b-4f2f-855c-317cea317abd None None] MFA Rules not processed for user `d566460db5e848828965adc580332fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:42.669849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c13ee784-977b-4f2f-855c-317cea317abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:42.691395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 814/1642] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:42 2022] PUT /identity/v3/projects/0a2a03de82be4b7092e241b5514adeb3/users/ac670f4da4254ee382600a323ee44c90/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:42.691395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.691395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.691395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.732898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:42.734359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:42.787635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 829/1643] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:42.789251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.789541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.789820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.833343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] MFA Rules not processed for user `18ae4716dd5041cc973f7eb0077f88b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:42.834676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:42.844288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 815/1644] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:42.845469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.865806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:42.930148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 830/1645] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:42.931896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:42.935912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7ab52-6926-4daa-8c5d-82c6ead39d1f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:42.944995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:42.946031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:42.946521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:42.947019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:42.948589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:42.950794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:42.967882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 816/1646] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:42.969562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:43.037261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26403f-1a18-48b5-a519-6d0118e30a4c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:43.043675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:43.044850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:43.045300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:43.046009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:43.055032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01f4e9-57cc-4cec-8bfc-522e78a75166 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:43.064123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c479d-b802-49de-9233-08a5166bb78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:43.064123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c479d-b802-49de-9233-08a5166bb78d service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:43.064123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c479d-b802-49de-9233-08a5166bb78d service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:43.064123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c479d-b802-49de-9233-08a5166bb78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:43.126130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:43.126130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:43.135826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 831/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:43.136390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:43.146604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c479d-b802-49de-9233-08a5166bb78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:43.149303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c479d-b802-49de-9233-08a5166bb78d service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:43.158430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f574-b851-48a0-9ab3-58ce4f9475a7 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:43.168398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:43.169682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:43.170062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:43.170410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] PATH_INFO: `/v3/projects/0a2a03de82be4b7092e241b5514adeb3/users/ac670f4da4254ee382600a323ee44c90/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:43.171807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 817/1648] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:43.185678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2a03de82be4b7092e241b5514adeb3, user_id=ac670f4da4254ee382600a323ee44c90, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:43.189739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:43.207332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 832/1649] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:43 2022] PUT /identity/v3/projects/0a2a03de82be4b7092e241b5514adeb3/users/ac670f4da4254ee382600a323ee44c90/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:43.218854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:43.219665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:43.222342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:43.295402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] MFA Rules not processed for user `ac670f4da4254ee382600a323ee44c90`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:43.299815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:43.318259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:43.444796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee1f28-b260-40ca-a632-6dc0757395c0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:43.454202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:43.455859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:43.456178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:43.458454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:43.469432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 818/1650] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:43.600719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:43.602785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:43.622083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 833/1651] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:43.756795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:43.986291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:44.542913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46409e-a27a-4304-99e2-600ce616afb8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:44.542913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:44.542913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:44.542913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:44.553471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:44.553471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:44.553471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:44.553471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 819/1652] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:44.577760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:44.577760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f00da4-b96e-4f56-b769-d598e76bc5dd service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:44.608204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:44.613910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:44.614895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:44.619650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:44.647563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:44.652722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:44.686921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:44.687101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 834/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:45.500345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:45.500429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:45.500429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dee676-1fd9-428d-96d5-b3d39a6a04ea service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:45.515697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f126aa5-b7bd-4e7f-98fa-ff5a5cfcf7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:45.517576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f126aa5-b7bd-4e7f-98fa-ff5a5cfcf7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:45.518225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f126aa5-b7bd-4e7f-98fa-ff5a5cfcf7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:45.518756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f126aa5-b7bd-4e7f-98fa-ff5a5cfcf7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:45.680032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f126aa5-b7bd-4e7f-98fa-ff5a5cfcf7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:45.680032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f126aa5-b7bd-4e7f-98fa-ff5a5cfcf7c2 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:45.725374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410fab3-c4d6-4111-9b20-e3dd5667d98a service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:45.733911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:45.743439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 835/1654] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:49:45.744558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:45.744558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:45.744558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:45.744558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] PATH_INFO: `/v3/users/878ff6767df742ce8437a1a1d492a29e` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:45.746462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878ff6767df742ce8437a1a1d492a29e)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:45.747508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: WARNING py.warnings [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:45.747508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: warnings.warn(msg) Jul 25 12:49:45.747508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: Jul 25 12:49:45.754215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:46.116205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:46.136679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227b01-2c69-498a-b6c2-db6506cdc5f6 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.137316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227b01-2c69-498a-b6c2-db6506cdc5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.137818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad227b01-2c69-498a-b6c2-db6506cdc5f6 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:46.139767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 836/1655] 10.222.0.45 () {54 vars in 962 bytes} [Mon Jul 25 12:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:49:46.151120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5529-97d0-480c-a969-ce8d4589def2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.151746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5529-97d0-480c-a969-ce8d4589def2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.156433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5529-97d0-480c-a969-ce8d4589def2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:46.156614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878ff6767df742ce8437a1a1d492a29e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:46.157173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878ff6767df742ce8437a1a1d492a29e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:46.162493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878ff6767df742ce8437a1a1d492a29e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:46.199368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-77ca5529-97d0-480c-a969-ce8d4589def2 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:46.201224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-77ca5529-97d0-480c-a969-ce8d4589def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:46.212935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 837/1656] 10.222.0.45 () {58 vars in 1059 bytes} [Mon Jul 25 12:49:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:49:46.220476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108229a8-0800-405d-bf36-c1df8e672843 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.221100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108229a8-0800-405d-bf36-c1df8e672843 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.222171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108229a8-0800-405d-bf36-c1df8e672843 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:46.224206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878ff6767df742ce8437a1a1d492a29e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:46.230505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 838/1657] 10.222.0.45 () {54 vars in 912 bytes} [Mon Jul 25 12:49:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:49:46.237914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf670e-b2a1-48cb-bdcf-c5f2c7a367a4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.237914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf670e-b2a1-48cb-bdcf-c5f2c7a367a4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.237914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf670e-b2a1-48cb-bdcf-c5f2c7a367a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:46.257123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878ff6767df742ce8437a1a1d492a29e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:46.259524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11cf670e-b2a1-48cb-bdcf-c5f2c7a367a4 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:46.281137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11cf670e-b2a1-48cb-bdcf-c5f2c7a367a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:46.308281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 839/1658] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:49:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:46.400406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 820/1659] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:49:45 2022] DELETE /identity/v3/users/878ff6767df742ce8437a1a1d492a29e => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:46.404539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.404836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.405110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:46.454339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:46.455737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:46.574574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 840/1660] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:46.601204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:46.602892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:46.765476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d5aa-2185-4dbe-9a74-9f370cb36c67 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:46.785235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:46.787999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:46.790744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:46.791422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.791703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.793117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:46.816869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:46.820990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:46.844193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 821/1661] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:46.916923 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e344cba-a72b-4ba3-b226-7c8fbdf08691 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:46.922867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:46.924949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:46.925550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:46.926656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:47.099032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:47.100219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:47.119541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 841/1662] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:47.588638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:48.268105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:48.270635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:48.331979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b6bfa-39a4-4424-955d-06b98dfb1cfa service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:48.346541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:48.350283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:48.351990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:48.352511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] PATH_INFO: `/v3/projects/7c4f5bb8021741e489822d1377cb2ee0` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:48.356158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4f5bb8021741e489822d1377cb2ee0)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:48.362790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:48.563481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:48.569446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4f5bb8021741e489822d1377cb2ee0', 'request_id': 'req-fff573fc-05b4-482f-aa07-8d1a2f7b4234'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:48.591436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4f5bb8021741e489822d1377cb2ee0', 'request_id': 'req-fff573fc-05b4-482f-aa07-8d1a2f7b4234'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:48.608033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4f5bb8021741e489822d1377cb2ee0', 'request_id': 'req-fff573fc-05b4-482f-aa07-8d1a2f7b4234'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:48.766374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] The token cache is being invalidate because project 7c4f5bb8021741e489822d1377cb2ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:49:48.769056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:48.772488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:48.784520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 822/1663] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:49:48 2022] DELETE /identity/v3/projects/7c4f5bb8021741e489822d1377cb2ee0 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:48.789478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:48.813540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058f375d-e6e2-47ce-b0ff-bd11fff1fb5a service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:48.931661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:48.932596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:48.932881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:48.933159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] PATH_INFO: `/v3/users/d566460db5e848828965adc580332fc2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:48.935612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d566460db5e848828965adc580332fc2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:48.940055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:48.948842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:48.950996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:49.014198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff573fc-05b4-482f-aa07-8d1a2f7b4234 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:49.038613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:49.041211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:49.045735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:49.045735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] PATH_INFO: `/v3/users/d43291d867134ac7b4ff20df86c94cf1` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:49.047617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43291d867134ac7b4ff20df86c94cf1)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:49.057924 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:49.218471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd566460db5e848828965adc580332fc2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.220199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd566460db5e848828965adc580332fc2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.222675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd566460db5e848828965adc580332fc2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.238306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:49.255248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd566460db5e848828965adc580332fc2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.271158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-24cbbf2b-a8e8-4b3c-845f-da6738bb0f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd566460db5e848828965adc580332fc2'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.334370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43291d867134ac7b4ff20df86c94cf1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.335313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43291d867134ac7b4ff20df86c94cf1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.336108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43291d867134ac7b4ff20df86c94cf1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.363300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43291d867134ac7b4ff20df86c94cf1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.382133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43291d867134ac7b4ff20df86c94cf1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:49.432782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 842/1664] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:49:48 2022] DELETE /identity/v3/users/d566460db5e848828965adc580332fc2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:49.566380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 823/1665] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:49:48 2022] DELETE /identity/v3/users/d43291d867134ac7b4ff20df86c94cf1 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:49.571292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb7a0-ace6-48cf-b2f2-8cbea7438cb4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:49.571905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb7a0-ace6-48cf-b2f2-8cbea7438cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:49.572371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb7a0-ace6-48cf-b2f2-8cbea7438cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:49.630774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c2ebb7a0-ace6-48cf-b2f2-8cbea7438cb4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:49.632433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2ebb7a0-ace6-48cf-b2f2-8cbea7438cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:49.878288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 843/1666] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:49.912479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:49.914547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:50.069070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f338d-d719-486c-927f-51659f04f3ea admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:50.082163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:50.082887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:50.083228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:50.083511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:50.102439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:50.105126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:50.143535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 824/1667] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:51.591169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:51.591680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:51.591752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:51.631787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] MFA Rules not processed for user `c548901a69404c2baf8392e79f35c2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:51.633540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:51.647650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:51.649140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:51.712425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0377ca-8fc5-4464-b0ed-e99f8258da20 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:51.725995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:51.728106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:51.729479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:51.729872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] PATH_INFO: `/v3/projects/18f9fb888d4944868ba02e79e1909036` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:51.733177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f9fb888d4944868ba02e79e1909036)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:51.741434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:51.767844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 844/1668] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:51.780532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:51.782283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:51.914398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:51.938735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ab4c-0140-4ceb-9cfa-5503e4216f04 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:51.943083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f9fb888d4944868ba02e79e1909036', 'request_id': 'req-6230d212-8209-43ca-a302-ab4db80bb91c'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:51.955064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f9fb888d4944868ba02e79e1909036', 'request_id': 'req-6230d212-8209-43ca-a302-ab4db80bb91c'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:51.965559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f9fb888d4944868ba02e79e1909036', 'request_id': 'req-6230d212-8209-43ca-a302-ab4db80bb91c'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.040552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f657c-c2eb-4747-a0ea-e3ff71315b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:52.041463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f657c-c2eb-4747-a0ea-e3ff71315b76 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.041903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f657c-c2eb-4747-a0ea-e3ff71315b76 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.042326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f657c-c2eb-4747-a0ea-e3ff71315b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.081148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] The token cache is being invalidate because project 18f9fb888d4944868ba02e79e1909036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:49:52.081612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.084548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6230d212-8209-43ca-a302-ab4db80bb91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.093606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 825/1669] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:49:51 2022] DELETE /identity/v3/projects/18f9fb888d4944868ba02e79e1909036 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:52.100193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.100540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.100831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.155939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:52.159463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:52.216862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f657c-c2eb-4747-a0ea-e3ff71315b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:52.218654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f657c-c2eb-4747-a0ea-e3ff71315b76 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:52.233482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 845/1670] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:52.319739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 826/1671] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:52.328876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.329172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.329453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.376762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:52.378948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:52.417161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 846/1672] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:52.428388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:52.431806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:52.431806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:52.437605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80bba4-8fa7-44d9-9308-f15f0706eee2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:52.450866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c29e4c-364b-4e2c-8285-61426265a7e2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:52.454512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:52.455315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.455424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.455724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.460819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:52.462411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:52.462411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:52.464325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:52.467417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:52.468623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.475868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.475868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] PATH_INFO: `/v3/projects/4b0d563f94cf41f39086f16890e6752f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.475868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0d563f94cf41f39086f16890e6752f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:52.476340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: WARNING py.warnings [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 12:49:52.476340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: warnings.warn(msg) Jul 25 12:49:52.476340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: Jul 25 12:49:52.477841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:52.500664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 827/1673] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:52.501698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:52.515622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189e6c-5042-49c6-8406-14f22f41ac82 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:52.523368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:52.529186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.529186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.529186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.529186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:52.529186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:52.698890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 828/1674] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:52 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:49:52.705144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:52.794385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0d563f94cf41f39086f16890e6752f', 'request_id': 'req-0d3483b0-7ac1-40ef-b20d-23fd510b5568'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.808670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0d563f94cf41f39086f16890e6752f', 'request_id': 'req-0d3483b0-7ac1-40ef-b20d-23fd510b5568'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.907464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0d563f94cf41f39086f16890e6752f', 'request_id': 'req-0d3483b0-7ac1-40ef-b20d-23fd510b5568'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.915518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f120a-6068-41f5-8e13-c02b3b2183c1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:52.924669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:52.925374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:52.925743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:52.928044 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:52.932448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:52.949372 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] The token cache is being invalidate because project 4b0d563f94cf41f39086f16890e6752f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:49:52.949664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.950231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:52.950678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:52.957137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 847/1675] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:49:52 2022] DELETE /identity/v3/projects/4b0d563f94cf41f39086f16890e6752f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:49:52.958863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:52.966099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:53.154751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3483b0-7ac1-40ef-b20d-23fd510b5568 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:53.160943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:53.162603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:53.163007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:53.163399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] PATH_INFO: `/v3/users/ac670f4da4254ee382600a323ee44c90` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:53.164867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac670f4da4254ee382600a323ee44c90)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:53.165169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 829/1676] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:52 2022] POST /identity/v3/users => generated 294 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:53.167162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:53.170987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:53.173337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:53.213035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91738a2-63e1-4057-9698-53167f332618 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:53.228692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:53.229669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:53.230032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:53.230609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:53.231250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:53.234721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:53.259117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 830/1677] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:53.263089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:53.296816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1e5ac-a365-4158-a8e3-d45a18355f53 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:53.315870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:53.318789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:53.319297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:53.319790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:53.320923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:53.330706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:53.389790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 831/1678] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:49:53.392241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:53.434924 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358c5c7-be77-4a7b-b537-3944e59213a3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:53.451660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f18aba-8bd4-41eb-859c-9d8be0bf4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:53.457868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18aba-8bd4-41eb-859c-9d8be0bf4dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:53.460280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18aba-8bd4-41eb-859c-9d8be0bf4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:53.460671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f18aba-8bd4-41eb-859c-9d8be0bf4dc6 admin admin] PATH_INFO: `/v3/projects/ab57aa89cd884ed8ab9ca693aee01520/users/63cc81025ccb44da9f6c9c822fe540c9/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:53.497502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f18aba-8bd4-41eb-859c-9d8be0bf4dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab57aa89cd884ed8ab9ca693aee01520, user_id=63cc81025ccb44da9f6c9c822fe540c9, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:53.502151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f18aba-8bd4-41eb-859c-9d8be0bf4dc6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:53.531103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac670f4da4254ee382600a323ee44c90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:53.533160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac670f4da4254ee382600a323ee44c90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:53.537517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac670f4da4254ee382600a323ee44c90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:53.581737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac670f4da4254ee382600a323ee44c90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:53.607879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac670f4da4254ee382600a323ee44c90'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:53.615477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 832/1679] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:53 2022] PUT /identity/v3/projects/ab57aa89cd884ed8ab9ca693aee01520/users/63cc81025ccb44da9f6c9c822fe540c9/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:53.625887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:53.626177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:53.626458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:53.805369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] MFA Rules not processed for user `63cc81025ccb44da9f6c9c822fe540c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:53.805369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:53.885644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 848/1680] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:49:52 2022] DELETE /identity/v3/users/ac670f4da4254ee382600a323ee44c90 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:54.033086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:54.034590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:54.034713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 833/1681] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:54.287969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9195cee-8c0c-4f9d-b762-47b84284a772 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:54.311247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9500c7-f850-4688-96c1-723726d6d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:54.312140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9500c7-f850-4688-96c1-723726d6d64c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:54.312550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9500c7-f850-4688-96c1-723726d6d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:54.313080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9500c7-f850-4688-96c1-723726d6d64c admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:54.313751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9500c7-f850-4688-96c1-723726d6d64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:54.317521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9500c7-f850-4688-96c1-723726d6d64c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:54.492762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 849/1682] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:54 2022] POST /identity/v3/projects => generated 387 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:49:54.496689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:54.593153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:54.593370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:54.593592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:54.690497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] MFA Rules not processed for user `93c4b63d65304186ba0ba06a6a31f3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:54.697780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:54.762108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09219b-5ee2-4644-862c-44ab4535642e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:54.892428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 850/1683] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:49:54.895515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:54.903494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:54.990744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:54.991738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:54.995154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:54.995646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:54.996578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:55.002995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:55.069867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effd3bf-af3f-44ed-aa55-1ae5464b9f28 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:55.077828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:55.078522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:55.078795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:55.079074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:55.094632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:55.095423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:55.116194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 834/1684] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:54 2022] POST /identity/v3/users => generated 300 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:55.123425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:55.148203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f50f-c633-45be-9c23-af233b8583f3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:55.148731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 851/1685] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:55.167212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:55.168758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:55.169390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:55.170077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:55.170997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:55.177226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:55.198517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:55.199774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:55.216291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 835/1686] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:49:55.219562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:55.229626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba6aa-c541-456a-a3ed-1f18bb6179fb service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:55.237770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef0bb-e517-430c-becb-6e05f5060015 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:55.242637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:55.243529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:55.243814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:55.244140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] PATH_INFO: `/v3/users/7e57544908594b31a68a35a3ad9ee840` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:55.245584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e57544908594b31a68a35a3ad9ee840)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:55.261780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:55.261997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:55.261997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:55.261997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:55.261997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] PATH_INFO: `/v3/projects/3bbc3f42c0424d65903f5e36527110b8/users/5d65d27cd4df431d8bd3cbf51590ab1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:55.312055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbc3f42c0424d65903f5e36527110b8, user_id=5d65d27cd4df431d8bd3cbf51590ab1f, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:55.337517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:55.471240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 836/1687] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:55 2022] PUT /identity/v3/projects/3bbc3f42c0424d65903f5e36527110b8/users/5d65d27cd4df431d8bd3cbf51590ab1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:55.472391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:55.475691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:55.579681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e57544908594b31a68a35a3ad9ee840'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.582852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e57544908594b31a68a35a3ad9ee840'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.586605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e57544908594b31a68a35a3ad9ee840'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.591215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8939be-42be-462a-9686-e24276200757 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:55.603165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:55.604494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:55.604946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:55.605377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] PATH_INFO: `/v3/projects/0a2a03de82be4b7092e241b5514adeb3` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:55.608845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2a03de82be4b7092e241b5514adeb3)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:55.611910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:55.627062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e57544908594b31a68a35a3ad9ee840'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.656592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e57544908594b31a68a35a3ad9ee840'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.838942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 852/1688] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:49:55 2022] DELETE /identity/v3/users/7e57544908594b31a68a35a3ad9ee840 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:55.841921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:55.843413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:55.887351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2a03de82be4b7092e241b5514adeb3', 'request_id': 'req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.917799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2a03de82be4b7092e241b5514adeb3', 'request_id': 'req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:55.938579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2a03de82be4b7092e241b5514adeb3', 'request_id': 'req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:56.009755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec646-ca24-4d78-b778-082363e08000 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:56.126101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] The token cache is being invalidate because project 0a2a03de82be4b7092e241b5514adeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:49:56.126567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:56.131376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-88ccc52f-6a70-4d04-ac2c-259860a1c2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:56.140758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 837/1689] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:49:55 2022] DELETE /identity/v3/projects/0a2a03de82be4b7092e241b5514adeb3 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:56.141792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc3aa8-6f37-4449-a14e-b0d590fd0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:56.142719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc3aa8-6f37-4449-a14e-b0d590fd0a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.143226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc3aa8-6f37-4449-a14e-b0d590fd0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.143754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc3aa8-6f37-4449-a14e-b0d590fd0a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.144558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.145457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc3aa8-6f37-4449-a14e-b0d590fd0a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:56.146189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.146489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.148715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc3aa8-6f37-4449-a14e-b0d590fd0a80 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:56.152319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:56.164817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 853/1690] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:56.166595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b675a-70de-40ac-99bd-bcfc169609ce None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.167090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b675a-70de-40ac-99bd-bcfc169609ce None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.167580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b675a-70de-40ac-99bd-bcfc169609ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.191094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc5b675a-70de-40ac-99bd-bcfc169609ce None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:56.193062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc5b675a-70de-40ac-99bd-bcfc169609ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.198485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:56.201746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.204506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 854/1691] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:56.206125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.207325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.208047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.248568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 838/1692] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:56.257786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] MFA Rules not processed for user `ba34e08ed3594bc38a17abf6906b9b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:56.259232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.263450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:56.266567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.291506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c141-cb3a-4b06-98cc-8d8dda7a2725 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:56.300136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24154-b55d-478e-bb19-c34b617c015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:56.302016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24154-b55d-478e-bb19-c34b617c015d admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.302159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24154-b55d-478e-bb19-c34b617c015d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.302379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24154-b55d-478e-bb19-c34b617c015d admin admin] PATH_INFO: `/v3/projects/3bbc3f42c0424d65903f5e36527110b8/users/5d65d27cd4df431d8bd3cbf51590ab1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.305411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24154-b55d-478e-bb19-c34b617c015d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbc3f42c0424d65903f5e36527110b8, user_id=5d65d27cd4df431d8bd3cbf51590ab1f, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:56.310517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24154-b55d-478e-bb19-c34b617c015d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:56.327602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 839/1693] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:56 2022] PUT /identity/v3/projects/3bbc3f42c0424d65903f5e36527110b8/users/5d65d27cd4df431d8bd3cbf51590ab1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:56.329136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f51a94-2b6a-4eb0-9cce-8ec18a4042ea None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.329432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f51a94-2b6a-4eb0-9cce-8ec18a4042ea None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.331849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f51a94-2b6a-4eb0-9cce-8ec18a4042ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.374538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-f8f51a94-2b6a-4eb0-9cce-8ec18a4042ea None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:56.375907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f8f51a94-2b6a-4eb0-9cce-8ec18a4042ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.386376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:56.464820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 855/1694] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:56.466016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:56.470309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.547223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 840/1695] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:56.554563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1bb54-5b07-4394-8755-dec5ee2ed46e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.560232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1bb54-5b07-4394-8755-dec5ee2ed46e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.560232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1bb54-5b07-4394-8755-dec5ee2ed46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.596319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609c2c1-0f8d-4fba-b679-641170da0a49 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:56.600619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-aea1bb54-5b07-4394-8755-dec5ee2ed46e None None] MFA Rules not processed for user `5d65d27cd4df431d8bd3cbf51590ab1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:56.602071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-aea1bb54-5b07-4394-8755-dec5ee2ed46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.735908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 841/1696] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:56.741484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.741484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.741484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.784506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:56.788297 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.788757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.789785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.821644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:56.830939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:56.845761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 856/1697] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:56.846640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:56.855744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] MFA Rules not processed for user `ba34e08ed3594bc38a17abf6906b9b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:56.864497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:56.866581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05d6cb-c606-4af0-aaf3-e3d28c03b80f service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:56.880807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:56.883012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:56.883767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:56.884863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:56.885814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:56.886281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:56.890061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:56.906783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 857/1698] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:56.908339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:56.911550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:57.024415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 842/1699] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:57.026570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.045735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1feea2-ced1-4f2a-a126-6ce1fbbe99ac admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.053951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.054678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.055068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.055418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.057468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a383a-58e0-4441-b33b-c58ebc3832bf None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.089889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.090721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.091316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.091433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.092344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.100919 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.102417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.102535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.124367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 858/1700] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:57.126472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.132877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:57.319180 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4c07-8a13-47d7-9e91-62331ef6582d service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.325662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 843/1701] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:57 2022] POST /identity/v3/projects => generated 363 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:57.325662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.336779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.337499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.337775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.338054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.360080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.361632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.392221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 859/1702] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:57.394256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.417715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64acf87c-ab7d-410f-9f1a-9579c20c6218 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.543565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844780-c7ad-4ad3-82a0-efab2d62b74e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.578496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.579766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.580325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.580817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] PATH_INFO: `/v3/users/63cc81025ccb44da9f6c9c822fe540c9` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.589420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cc81025ccb44da9f6c9c822fe540c9)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.591724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.620737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.621599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.621841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.621963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.622819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.631624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.738639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 860/1703] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:57 2022] POST /identity/v3/users => generated 282 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:57.743700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.768525 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecdeee-7c4f-41f6-8ea4-ffef4bd7ee0c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.787544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.788576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.788997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.789279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.790691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.792927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.844115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 861/1704] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:49:57.847265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.882827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf54b5-4be2-4f83-8a65-405fde0fb780 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:57.898378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:57.901203 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:57.907231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:57.916395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:57.918907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:57.926370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:57.935490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cc81025ccb44da9f6c9c822fe540c9'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:57.937864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cc81025ccb44da9f6c9c822fe540c9'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:57.940028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cc81025ccb44da9f6c9c822fe540c9'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:57.975758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 862/1705] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:57.980997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:57.984561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:57.993320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cc81025ccb44da9f6c9c822fe540c9'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.031635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cc81025ccb44da9f6c9c822fe540c9'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.066805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18e79f-6fa9-4c59-8cf8-44caed22dfd5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:58.084469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159f926-4380-422c-a4d5-68927e8ea623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:58.085502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f926-4380-422c-a4d5-68927e8ea623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.085697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f926-4380-422c-a4d5-68927e8ea623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.085942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f926-4380-422c-a4d5-68927e8ea623 admin admin] PATH_INFO: `/v3/projects/7f62876c1698464d9446392d091d06de/users/c427949a5de54eb79c0736b823a61bf6/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.130331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159f926-4380-422c-a4d5-68927e8ea623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f62876c1698464d9446392d091d06de, user_id=c427949a5de54eb79c0736b823a61bf6, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:58.137448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159f926-4380-422c-a4d5-68927e8ea623 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:58.151961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 844/1706] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:49:57 2022] DELETE /identity/v3/users/63cc81025ccb44da9f6c9c822fe540c9 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:58.153160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:58.156735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:58.287050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 863/1707] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:57 2022] PUT /identity/v3/projects/7f62876c1698464d9446392d091d06de/users/c427949a5de54eb79c0736b823a61bf6/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:58.289677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c997f-764b-41d5-b472-2ea07ab4d8d3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.290063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c997f-764b-41d5-b472-2ea07ab4d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.290440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c997f-764b-41d5-b472-2ea07ab4d8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.294879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1be3e-b345-4129-baa5-91d3d0290f63 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:58.357879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a72c997f-764b-41d5-b472-2ea07ab4d8d3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:58.359715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a72c997f-764b-41d5-b472-2ea07ab4d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:58.429003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:58.429882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.430665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.430665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] PATH_INFO: `/v3/projects/391c01de1d2b41f38ba50166a514848e` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.432945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391c01de1d2b41f38ba50166a514848e)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:58.440513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:58.483964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:58.526194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 864/1708] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:58.527629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da909c-140a-4948-a742-12e42148052a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.528721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da909c-140a-4948-a742-12e42148052a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.531100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da909c-140a-4948-a742-12e42148052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.601768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a7da909c-140a-4948-a742-12e42148052a None None] MFA Rules not processed for user `c427949a5de54eb79c0736b823a61bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:58.603069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a7da909c-140a-4948-a742-12e42148052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:58.646906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391c01de1d2b41f38ba50166a514848e', 'request_id': 'req-5ae41109-8ded-4b78-b5c0-7009ed6845c6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.674195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391c01de1d2b41f38ba50166a514848e', 'request_id': 'req-5ae41109-8ded-4b78-b5c0-7009ed6845c6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.708438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391c01de1d2b41f38ba50166a514848e', 'request_id': 'req-5ae41109-8ded-4b78-b5c0-7009ed6845c6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.808062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] The token cache is being invalidate because project 391c01de1d2b41f38ba50166a514848e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:49:58.813246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.813246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:49:58.813859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 865/1709] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:58.814214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 845/1710] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:49:58 2022] DELETE /identity/v3/projects/391c01de1d2b41f38ba50166a514848e => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:49:58.815350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:58.818179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf9ef-8c9d-4483-ab46-aba7c3d30f71 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.818750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf9ef-8c9d-4483-ab46-aba7c3d30f71 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.819101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdf9ef-8c9d-4483-ab46-aba7c3d30f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.825683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:58.844198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9bfdf9ef-8c9d-4483-ab46-aba7c3d30f71 None None] MFA Rules not processed for user `c548901a69404c2baf8392e79f35c2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:58.845724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9bfdf9ef-8c9d-4483-ab46-aba7c3d30f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:58.913196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:49:58.932815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 866/1711] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:58.936536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c43b42-817e-4cef-8b8b-7a80d50b33b8 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.936536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c43b42-817e-4cef-8b8b-7a80d50b33b8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.936536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c43b42-817e-4cef-8b8b-7a80d50b33b8 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.936536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 867/1712] 10.222.0.45 () {54 vars in 912 bytes} [Mon Jul 25 12:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:49:58.939225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c43b42-817e-4cef-8b8b-7a80d50b33b8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:58.944111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-57c43b42-817e-4cef-8b8b-7a80d50b33b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:58.954910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41109-8ded-4b78-b5c0-7009ed6845c6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:58.967392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:58.968102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:58.968379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:58.968659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:58.977287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:59.059802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c43b42-817e-4cef-8b8b-7a80d50b33b8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.082391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7e35-0f6e-4eca-a0de-09b364c516df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.083913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7e35-0f6e-4eca-a0de-09b364c516df admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.084385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7e35-0f6e-4eca-a0de-09b364c516df admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.084826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7e35-0f6e-4eca-a0de-09b364c516df admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.089345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7e35-0f6e-4eca-a0de-09b364c516df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.091499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7e35-0f6e-4eca-a0de-09b364c516df admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.134388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.151664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aff977-3d2f-4852-b6f6-3dfe75d001c7 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.190177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 846/1713] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:59.191943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.192772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.192772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.256663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:59.258768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:59.265319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 868/1714] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:58 2022] POST /identity/v3/projects => generated 365 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:59.267495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53c7ef-6bba-49f0-a175-cf0d88b1a5d0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.267801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53c7ef-6bba-49f0-a175-cf0d88b1a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.268112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53c7ef-6bba-49f0-a175-cf0d88b1a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.404034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1c53c7ef-6bba-49f0-a175-cf0d88b1a5d0 None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:59.407002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c53c7ef-6bba-49f0-a175-cf0d88b1a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:59.494253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 847/1715] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:59.498803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:59.541629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de34747-1dc3-4cbb-9039-df7ca90a6409 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.558105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.558961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.559251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.559529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.562849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.568267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 869/1716] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:59.571035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.571035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.571035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.571591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.627832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:59.631474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:59.661495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 870/1717] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:59.662451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:59.663902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:59.713373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9b2ab-065c-435e-8113-d691dbafda16 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.729759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03b2a-59b5-4d51-84e6-556215ffabf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.730437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03b2a-59b5-4d51-84e6-556215ffabf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.730723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03b2a-59b5-4d51-84e6-556215ffabf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.731000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03b2a-59b5-4d51-84e6-556215ffabf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.760568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03b2a-59b5-4d51-84e6-556215ffabf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.762083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03b2a-59b5-4d51-84e6-556215ffabf7 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.766270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 848/1718] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:49:59 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:49:59.766270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:59.777742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 871/1719] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:49:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:49:59.779091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033fc86-329d-43f0-9e1a-6961e7dd3b84 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.779452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033fc86-329d-43f0-9e1a-6961e7dd3b84 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.779835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033fc86-329d-43f0-9e1a-6961e7dd3b84 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.786044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 872/1720] 10.222.0.45 () {54 vars in 912 bytes} [Mon Jul 25 12:49:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:49:59.786826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033fc86-329d-43f0-9e1a-6961e7dd3b84 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:59.795501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196899fc-d0f3-45b8-bc6a-7a8d0f21c9f8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.808007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033fc86-329d-43f0-9e1a-6961e7dd3b84 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.808775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.811530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.812645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085d8d1-4ba9-4a68-8093-99ee31c2c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.813046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.813323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085d8d1-4ba9-4a68-8093-99ee31c2c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.813695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085d8d1-4ba9-4a68-8093-99ee31c2c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.813976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085d8d1-4ba9-4a68-8093-99ee31c2c6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.814290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.814954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085d8d1-4ba9-4a68-8093-99ee31c2c6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.816842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085d8d1-4ba9-4a68-8093-99ee31c2c6ce admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.829977 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:49:59.831360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.833642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.837002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 873/1721] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:49:59.839977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.840278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.840563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.857570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 849/1722] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:49:59.866884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:59.876479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:49:59.878173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:49:59.892212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 874/1723] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:49:59.893135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:49:59.917635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a3ab3-3ab0-4e3f-83c1-fa4075349a4d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.924252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6dff8-0f43-4ba2-ac81-c6393f530a55 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:49:59.926544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.927513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.928063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.928521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.929496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.932683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:49:59.933167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:49:59.934431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:49:59.934723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:49:59.934996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] PATH_INFO: `/v3/projects/e1250244af5743f2967fbbfc20460f21/users/85da45f4e9e440b1984e86f32095c306/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:49:59.958515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1250244af5743f2967fbbfc20460f21, user_id=85da45f4e9e440b1984e86f32095c306, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:49:59.962016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.138159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 850/1724] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:49:59 2022] PUT /identity/v3/projects/e1250244af5743f2967fbbfc20460f21/users/85da45f4e9e440b1984e86f32095c306/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:00.140134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.141820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 875/1725] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:49:59 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:00.143734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.145813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:00.259789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a181-4555-48c9-81bf-db1e9d04ec09 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:00.265583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:00.266019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:00.267266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:00.267550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:00.280642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:00.282265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.298903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 876/1726] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:00.299784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.318705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4c65e-7ff5-4792-a9d3-34a0124025b6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:00.390359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd82ba0-1316-4292-af17-59e112188abc service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:00.397298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:00.398412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:00.399056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:00.399585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:00.400536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:00.402520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.415656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 877/1727] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:00.416901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.423154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:00.424214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:00.424626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:00.424970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] PATH_INFO: `/v3/users/be32c4b0a5714e60ae19e3538652cc60` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:00.430204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be32c4b0a5714e60ae19e3538652cc60)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:00.431364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12880b9a-9f72-431f-917b-d4b165f85eab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:00.433309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.437841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:00.438741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:00.439773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:00.440457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:00.441999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:00.444489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.546024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 878/1728] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:00 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:00.546795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.559111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770576a-a0e0-4436-b4d1-1f6837a615e7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:00.571409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:00.573426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:00.573426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:00.573426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] PATH_INFO: `/v3/projects/e1250244af5743f2967fbbfc20460f21/users/85da45f4e9e440b1984e86f32095c306/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:00.576635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1250244af5743f2967fbbfc20460f21, user_id=85da45f4e9e440b1984e86f32095c306, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:00.580156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.603573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 879/1729] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:00 2022] PUT /identity/v3/projects/e1250244af5743f2967fbbfc20460f21/users/85da45f4e9e440b1984e86f32095c306/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:00.603573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.603573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:00.711868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b46dd-bbf1-4cde-bddb-df0371c0f95b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:00.723856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:00.726188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:00.727657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:00.728046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] PATH_INFO: `/v3/projects/ab57aa89cd884ed8ab9ca693aee01520` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:00.730285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab57aa89cd884ed8ab9ca693aee01520)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:00.734952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:00.771758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be32c4b0a5714e60ae19e3538652cc60'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.774319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be32c4b0a5714e60ae19e3538652cc60'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.778862 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be32c4b0a5714e60ae19e3538652cc60'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.811239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be32c4b0a5714e60ae19e3538652cc60'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.823118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be32c4b0a5714e60ae19e3538652cc60'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.906001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab57aa89cd884ed8ab9ca693aee01520', 'request_id': 'req-4ae342d1-2838-46a0-a709-8c2ed51d1657'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.918219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab57aa89cd884ed8ab9ca693aee01520', 'request_id': 'req-4ae342d1-2838-46a0-a709-8c2ed51d1657'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:00.927517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 851/1730] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:00 2022] DELETE /identity/v3/users/be32c4b0a5714e60ae19e3538652cc60 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:00.928681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:00.938837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.054578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ad360-ab81-4c25-84d9-02ab5760d62b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:01.060510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff52922-a4db-4ad7-9bf1-9e99e4b329d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:01.061280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff52922-a4db-4ad7-9bf1-9e99e4b329d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.061639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff52922-a4db-4ad7-9bf1-9e99e4b329d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.062057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff52922-a4db-4ad7-9bf1-9e99e4b329d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.063375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff52922-a4db-4ad7-9bf1-9e99e4b329d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:01.065535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff52922-a4db-4ad7-9bf1-9e99e4b329d1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:01.083538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 852/1731] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:01.091371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c842d-7e7c-4b92-8a68-8155c3f4acbd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.091660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c842d-7e7c-4b92-8a68-8155c3f4acbd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.091959 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c842d-7e7c-4b92-8a68-8155c3f4acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.094921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab57aa89cd884ed8ab9ca693aee01520', 'request_id': 'req-4ae342d1-2838-46a0-a709-8c2ed51d1657'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.117629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] The token cache is being invalidate because project ab57aa89cd884ed8ab9ca693aee01520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:01.117932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.118620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4ae342d1-2838-46a0-a709-8c2ed51d1657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.120563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 880/1732] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:00 2022] DELETE /identity/v3/projects/ab57aa89cd884ed8ab9ca693aee01520 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:01.123410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efd9c-6f79-41b9-ab84-a59dfc2cfcc5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.123693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efd9c-6f79-41b9-ab84-a59dfc2cfcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.124035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839efd9c-6f79-41b9-ab84-a59dfc2cfcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.131027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:01.145361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1d9c842d-7e7c-4b92-8a68-8155c3f4acbd None None] MFA Rules not processed for user `85da45f4e9e440b1984e86f32095c306`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:01.146645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1d9c842d-7e7c-4b92-8a68-8155c3f4acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.161006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-839efd9c-6f79-41b9-ab84-a59dfc2cfcc5 None None] MFA Rules not processed for user `93c4b63d65304186ba0ba06a6a31f3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:01.174690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-839efd9c-6f79-41b9-ab84-a59dfc2cfcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.335255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 881/1733] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:01.336687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832cc40-530b-47ad-a7db-0b907c4395e7 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.337329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832cc40-530b-47ad-a7db-0b907c4395e7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.347633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 853/1734] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:01.349551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.350682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.351171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.361696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832cc40-530b-47ad-a7db-0b907c4395e7 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.369235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 882/1735] 10.222.0.45 () {54 vars in 961 bytes} [Mon Jul 25 12:50:01 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:50:01.370252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832cc40-530b-47ad-a7db-0b907c4395e7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:01.376869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e832cc40-530b-47ad-a7db-0b907c4395e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.380123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:01.381364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.392907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 854/1736] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:01.392907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:01.392907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.408030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832cc40-530b-47ad-a7db-0b907c4395e7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:01.411452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:01.412284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.413151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.413536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.414376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:01.416491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:01.428747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda34be7-fb15-411e-bb82-76669725d773 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:01.437739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 883/1737] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:01.437739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:01.451768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:01.451768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.451768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.451768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] PATH_INFO: `/v3/users/5d65d27cd4df431d8bd3cbf51590ab1f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.452732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d65d27cd4df431d8bd3cbf51590ab1f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:01.461846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.462733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:01.561070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:01.610903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76eb5d0-98fd-40bb-ae4e-ce28ea860b52 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:01.617666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:01.618354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.618637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.618914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.620945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.638860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:01.644460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:01.660776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 884/1738] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:01.661677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:01.676406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.686637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d65d27cd4df431d8bd3cbf51590ab1f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.690516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d65d27cd4df431d8bd3cbf51590ab1f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.693847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d65d27cd4df431d8bd3cbf51590ab1f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.724905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d65d27cd4df431d8bd3cbf51590ab1f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.753115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da42121a-ef9d-4839-9432-6ca2b81c2bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d65d27cd4df431d8bd3cbf51590ab1f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:01.818033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21269b6-de78-442a-b5e3-e2fcc890daf8 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:01.826030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:01.826694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.826975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.827250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.829292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.871010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 855/1739] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:01 2022] DELETE /identity/v3/users/5d65d27cd4df431d8bd3cbf51590ab1f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:01.872757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:01.873053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:01.873334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:01.875224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:01.880212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:01.902439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 885/1740] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:01.905087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:01.916862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:01.930141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:01.948811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.186620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95ea8c-0a3c-4ba4-b8b7-35616888c806 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:02.211451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 856/1741] 10.222.0.45 () {58 vars in 1058 bytes} [Mon Jul 25 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:02.212471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:02.215078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.350620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:02.351304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:02.351643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:02.352023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:02.356875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.429274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29329fb8-1369-40a6-98c3-6815db65cf46 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:02.438025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82a4b-a862-4963-a487-39493b1ebe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:02.440133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82a4b-a862-4963-a487-39493b1ebe69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:02.442329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82a4b-a862-4963-a487-39493b1ebe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:02.442680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82a4b-a862-4963-a487-39493b1ebe69 admin admin] PATH_INFO: `/v3/projects/d38089e359a244759a8c2f666d118579/users/aba7f1f9ebbc4b1dbdfc467b1eb93f25/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:02.470812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:02.472365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:02.483481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 886/1742] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:02.484173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:02.497985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0bdae-bae8-4bac-9b48-7edb9147b85f service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:02.504001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:02.504672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:02.504967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:02.505229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:02.507042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.519325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:02.523447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:02.534322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82a4b-a862-4963-a487-39493b1ebe69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38089e359a244759a8c2f666d118579, user_id=aba7f1f9ebbc4b1dbdfc467b1eb93f25, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:02.541222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82a4b-a862-4963-a487-39493b1ebe69 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:02.543933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 887/1743] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:02.544879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:02.547048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.629909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 857/1744] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:02 2022] PUT /identity/v3/projects/d38089e359a244759a8c2f666d118579/users/aba7f1f9ebbc4b1dbdfc467b1eb93f25/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:02.645143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:02.645736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:02.646020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:02.669511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8b3a1-0e33-48b6-beab-970db2bedee4 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:02.738831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] MFA Rules not processed for user `aba7f1f9ebbc4b1dbdfc467b1eb93f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:02.741519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.797614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:02.798438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:02.798720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:02.798994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:02.802178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.924017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 858/1745] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:02.924017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:02.926288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:02.950038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:02.950038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:02.959463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 888/1746] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:02.960363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:03.047470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcc0b4-d904-468a-ae31-624c5d3b82ee service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.049643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff7e9-c455-41f0-8b92-d05f72c1e4e7 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.053835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.054553 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.054838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.055120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.055953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.056060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.058021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:03.064438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.064778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.064992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] PATH_INFO: `/v3/projects/3bbc3f42c0424d65903f5e36527110b8` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.067815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbc3f42c0424d65903f5e36527110b8)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.070344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:03.185153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 889/1747] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:02 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:03.186109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:03.265708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbc3f42c0424d65903f5e36527110b8', 'request_id': 'req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.291606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbc3f42c0424d65903f5e36527110b8', 'request_id': 'req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.310127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbc3f42c0424d65903f5e36527110b8', 'request_id': 'req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.325470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aade6-c072-4722-ba22-70f16d17766b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.436853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] The token cache is being invalidate because project 3bbc3f42c0424d65903f5e36527110b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:03.437319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.438583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.444584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 859/1748] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:02 2022] DELETE /identity/v3/projects/3bbc3f42c0424d65903f5e36527110b8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:03.448087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:03.450430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:03.488874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a3c6-bcb3-490b-b029-baad11405f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.494615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a3c6-bcb3-490b-b029-baad11405f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.494615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a3c6-bcb3-490b-b029-baad11405f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.494615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a3c6-bcb3-490b-b029-baad11405f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.494615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714a3c6-bcb3-490b-b029-baad11405f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.494615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714a3c6-bcb3-490b-b029-baad11405f75 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:03.553674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b629dcc-2d6e-47a5-9aef-25ec18f95e78 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.563456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.563456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.563456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.563456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] PATH_INFO: `/v3/projects/c54a871cd2e24c54a2195ff7449a3f46` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.566163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54a871cd2e24c54a2195ff7449a3f46)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.568458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:03.650659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 890/1749] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:03 2022] POST /identity/v3/users => generated 296 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:03.653354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.653712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.655384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.677496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:03.678720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:03.687302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 891/1750] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:03.687957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:03.697228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:03.710945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d68cb2-7027-4a69-af67-be403a74cc2e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.712568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54a871cd2e24c54a2195ff7449a3f46', 'request_id': 'req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.719283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:03.725756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54a871cd2e24c54a2195ff7449a3f46', 'request_id': 'req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.732951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54a871cd2e24c54a2195ff7449a3f46', 'request_id': 'req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.771250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f266abe-0f49-45cf-bbf7-3b8920a09425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.771979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f266abe-0f49-45cf-bbf7-3b8920a09425 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.772283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f266abe-0f49-45cf-bbf7-3b8920a09425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.772582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f266abe-0f49-45cf-bbf7-3b8920a09425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.773314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f266abe-0f49-45cf-bbf7-3b8920a09425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.775046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f266abe-0f49-45cf-bbf7-3b8920a09425 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:03.786369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 892/1751] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:03.787475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.787771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.788071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.812569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:03.814329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:03.820640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] The token cache is being invalidate because project c54a871cd2e24c54a2195ff7449a3f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:03.820938 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.822511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:03.827957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 860/1752] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:03 2022] DELETE /identity/v3/projects/c54a871cd2e24c54a2195ff7449a3f46 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:03.828383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:03.829831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:03.832928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 893/1753] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:03.834214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:03.847535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b5a6d-b2d9-4a73-b99a-2f45b0a24ef8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.855390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.855903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b495f-a87c-4d7e-8908-aa6b08dcc8c4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:03.856795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.857300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.857586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] PATH_INFO: `/v3/users/18ae4716dd5041cc973f7eb0077f88b8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.858916 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ae4716dd5041cc973f7eb0077f88b8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.861314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:03.862113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:03.864777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:03.865071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:03.865357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] PATH_INFO: `/v3/projects/3420c22779954c66844525749b76eba7/users/3176f08c95aa46139c9e72bc1044c6ca/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:03.884701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3420c22779954c66844525749b76eba7, user_id=3176f08c95aa46139c9e72bc1044c6ca, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:03.887414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.062905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 861/1754] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:03 2022] PUT /identity/v3/projects/3420c22779954c66844525749b76eba7/users/3176f08c95aa46139c9e72bc1044c6ca/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:04.062905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.062905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:04.134446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088cf4d-60da-47d7-90e1-d976f18dae02 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.139117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.139849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.140168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.140449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.141178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:04.141488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.143130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.161354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 862/1755] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:04.161354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.170745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bcd16-5b33-459d-86b6-b8d4b65a5c4b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.175636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.176421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.176741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.177088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.177808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.179455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.189486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 863/1756] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:04.190271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.216810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76096f8d-1880-4188-9afd-480bdad36af1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.223130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.223750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.224072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.224582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.227171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.227483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.227642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ae4716dd5041cc973f7eb0077f88b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:04.229810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ae4716dd5041cc973f7eb0077f88b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:04.230847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ae4716dd5041cc973f7eb0077f88b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:04.252521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ae4716dd5041cc973f7eb0077f88b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:04.261369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ae4716dd5041cc973f7eb0077f88b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:04.379306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 894/1757] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:03 2022] DELETE /identity/v3/users/18ae4716dd5041cc973f7eb0077f88b8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:04.379988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.382252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 864/1758] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:04 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:04.384026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:04.386664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.388472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:04.482691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29b9ba-0e60-42c1-8305-0b8254e49c7e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.495070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.495834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.496143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.496423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.497140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.499592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.533599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5db48-6e6e-45d6-926e-9ec6d064773f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.541699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7236ef-5df9-4eb2-81ad-b3015f2badd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.543503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:04.544093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7236ef-5df9-4eb2-81ad-b3015f2badd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.544590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7236ef-5df9-4eb2-81ad-b3015f2badd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.544958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7236ef-5df9-4eb2-81ad-b3015f2badd5 admin admin] PATH_INFO: `/v3/projects/3420c22779954c66844525749b76eba7/users/3176f08c95aa46139c9e72bc1044c6ca/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.547252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7236ef-5df9-4eb2-81ad-b3015f2badd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3420c22779954c66844525749b76eba7, user_id=3176f08c95aa46139c9e72bc1044c6ca, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.552410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7236ef-5df9-4eb2-81ad-b3015f2badd5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.561681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 895/1759] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:04 2022] PUT /identity/v3/projects/3420c22779954c66844525749b76eba7/users/3176f08c95aa46139c9e72bc1044c6ca/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:04.572755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.573049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.573331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.608262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] MFA Rules not processed for user `3176f08c95aa46139c9e72bc1044c6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:04.618508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:04.652048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 865/1760] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:04 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:04.653840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.682374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65d0d7-eab3-4e4d-9704-f649a3ce3654 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.777030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 896/1761] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:04.798540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.801449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:04.809146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.809965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.810350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.810736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.811572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.813903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.828273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 866/1762] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:04.829187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.843592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263ae5-1915-4f3e-9308-4a3d7b79a022 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.851380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.856861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.856861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.856861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.856861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.857905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.879024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 867/1763] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:04.880722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:04.903841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ae621-1b11-4e79-a91a-ee331d3562c0 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.905578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46994c-3510-44e7-9a28-35ed3f16b378 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:04.910168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.911142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.911461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdca61-6a82-471c-b629-cedcdbec7946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:04.911635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.912291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdca61-6a82-471c-b629-cedcdbec7946 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:04.912542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] PATH_INFO: `/v3/projects/205f4aed8ae743e486dafdf1e818bc22/users/4c1c2cf23adf4be9b7ea5ff1d7e4df51/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.912643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdca61-6a82-471c-b629-cedcdbec7946 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:04.912858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdca61-6a82-471c-b629-cedcdbec7946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:04.941882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdca61-6a82-471c-b629-cedcdbec7946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.941882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdca61-6a82-471c-b629-cedcdbec7946 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.951745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205f4aed8ae743e486dafdf1e818bc22, user_id=4c1c2cf23adf4be9b7ea5ff1d7e4df51, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:04.957475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:04.958821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 897/1764] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:05.068796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 868/1765] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:04 2022] PUT /identity/v3/projects/205f4aed8ae743e486dafdf1e818bc22/users/4c1c2cf23adf4be9b7ea5ff1d7e4df51/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:05.070404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.070992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.071475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.114515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] MFA Rules not processed for user `4c1c2cf23adf4be9b7ea5ff1d7e4df51`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:05.116135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:05.180213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.182465 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:05.217967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 898/1766] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:05.223375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.295480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14e42e-94b4-4a2e-9e4b-b03db67a7d64 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.299717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.301680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.301973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.302255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] PATH_INFO: `/v3/projects/c9217d8bb98145aba0316cade5e47145` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.304681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9217d8bb98145aba0316cade5e47145)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.306930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.307238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f6751-1363-410e-8342-c79375d2a3da None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.312031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.312685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.312965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.313234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.323749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.325709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.466981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 899/1767] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:05 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:05.466981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.484075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9217d8bb98145aba0316cade5e47145', 'request_id': 'req-d2826be4-1785-40a0-ad58-03c37f3ec10e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:05.492200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9217d8bb98145aba0316cade5e47145', 'request_id': 'req-d2826be4-1785-40a0-ad58-03c37f3ec10e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:05.511304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9217d8bb98145aba0316cade5e47145', 'request_id': 'req-d2826be4-1785-40a0-ad58-03c37f3ec10e'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:05.567454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d9c20-ed97-442b-8ecd-2f6e7c0730cf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.571749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.572438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.572726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.573004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.574815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:05.629565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] The token cache is being invalidate because project c9217d8bb98145aba0316cade5e47145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:05.635625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:05.635625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:05.635625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 869/1768] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:05 2022] DELETE /identity/v3/projects/c9217d8bb98145aba0316cade5e47145 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:05.635625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.635625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:05.642048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.643566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72bbf5-c89b-4c91-9ecd-cb6003b3ebba service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.657570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 900/1769] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:05.658355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:05.661991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81790e3b-71a2-49be-9b30-ba82246738d9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.662309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81790e3b-71a2-49be-9b30-ba82246738d9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.662762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81790e3b-71a2-49be-9b30-ba82246738d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.701992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-81790e3b-71a2-49be-9b30-ba82246738d9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:05.703215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-81790e3b-71a2-49be-9b30-ba82246738d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:05.713767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2826be4-1785-40a0-ad58-03c37f3ec10e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.776686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 901/1770] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:05.781216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.781714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.782075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.783892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.784801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.785088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.785383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.786161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.789685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.812876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:05.814325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:05.826428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 902/1771] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:05.827533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.829830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:05.840166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f145e0-9e2b-4d4a-81eb-d6f26f5a9bf8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.844094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.844760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.845041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.845319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.846076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:05.846383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.848101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.860227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 903/1772] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:05.865004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.874926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67991a6-dab7-4dd0-ac59-e26a515bfe93 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.880434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.881057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.881359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.881640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.882324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.884214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.904081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 870/1773] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:05 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:05.908226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.926885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775beec-f15b-4241-a67a-b10361984cd5 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.932643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.933411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.933739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.934101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:05.934810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:05.937154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:05.956580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 871/1774] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:05.956580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:05.989486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe793f5-a01b-45e0-a892-15d83d978c56 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:05.994979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:05.995970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:05.996277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:05.996583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] PATH_INFO: `/v3/projects/6cb605e8b5d44e36ae2fc10324deb630/users/e41dcf32b1a44eea97bdee2c8d8683b4/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.011113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 904/1775] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:05 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:06.015170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.020388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb605e8b5d44e36ae2fc10324deb630, user_id=e41dcf32b1a44eea97bdee2c8d8683b4, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.023376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.097211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d18b1-b912-48e9-b827-93c599a3e64f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.104769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.105638 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.105922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.106422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.107982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.110335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.144419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 872/1776] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:05 2022] PUT /identity/v3/projects/6cb605e8b5d44e36ae2fc10324deb630/users/e41dcf32b1a44eea97bdee2c8d8683b4/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:06.145454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.233307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 905/1777] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:06 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:06.233307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.251326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d22442-f106-40b9-b487-5c43190582fa admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.301180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162cc1-c71b-4060-8e9e-92a23298a668 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.311140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.311643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.312601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.313068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.314275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.316796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.338787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 873/1778] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:06.342863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.376914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e3cfe-9c14-43eb-8f52-561591909892 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.400700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134606e7-2c53-4933-8292-489b8417cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.401980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134606e7-2c53-4933-8292-489b8417cb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.402273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134606e7-2c53-4933-8292-489b8417cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.402538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134606e7-2c53-4933-8292-489b8417cb34 admin admin] PATH_INFO: `/v3/projects/6cb605e8b5d44e36ae2fc10324deb630/users/e41dcf32b1a44eea97bdee2c8d8683b4/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.403131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.404103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.404387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.405596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.406337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.408013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.410342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134606e7-2c53-4933-8292-489b8417cb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb605e8b5d44e36ae2fc10324deb630, user_id=e41dcf32b1a44eea97bdee2c8d8683b4, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.413057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134606e7-2c53-4933-8292-489b8417cb34 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.423855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 906/1779] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:06.425277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.439711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc1d56-60cc-4cc1-b0ec-c66f81245622 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.455392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 874/1780] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:06 2022] PUT /identity/v3/projects/6cb605e8b5d44e36ae2fc10324deb630/users/e41dcf32b1a44eea97bdee2c8d8683b4/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:06.467182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.467472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.467798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.502302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] MFA Rules not processed for user `e41dcf32b1a44eea97bdee2c8d8683b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:06.504525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:06.535181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.536329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.536760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.537056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.537821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.539566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.556730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 907/1781] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:06.557697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.573665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a2515-7180-4938-a79f-b2b348490895 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.581797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7286a2-162b-4eb9-b205-d440be7f5dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.582969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7286a2-162b-4eb9-b205-d440be7f5dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.583486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7286a2-162b-4eb9-b205-d440be7f5dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.583752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7286a2-162b-4eb9-b205-d440be7f5dc3 admin admin] PATH_INFO: `/v3/projects/c298b82f2e764a8e9f2dcf524eb7f0e4/users/d85a9daf56874fa5aa8b085ac1d0169f/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.620950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7286a2-162b-4eb9-b205-d440be7f5dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c298b82f2e764a8e9f2dcf524eb7f0e4, user_id=d85a9daf56874fa5aa8b085ac1d0169f, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.623911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7286a2-162b-4eb9-b205-d440be7f5dc3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.669935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 875/1782] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:06.673623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:06.679231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:06.689446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:06.759640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381d239-acc7-4a15-8595-d964245cab9f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:06.764707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:06.765433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.766780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.766888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.778219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:06.779798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:06.786658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 908/1783] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:06 2022] PUT /identity/v3/projects/c298b82f2e764a8e9f2dcf524eb7f0e4/users/d85a9daf56874fa5aa8b085ac1d0169f/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:06.797060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:06.797571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:06.797934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:06.802144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 876/1784] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:06.829756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] MFA Rules not processed for user `d85a9daf56874fa5aa8b085ac1d0169f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:06.831598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:07.006987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 909/1785] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:07.008631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:07.024634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd94c8a-46f1-4316-ad6c-843ae2d18a3b service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:07.089811 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:07.196911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a7273-e9cb-4af7-a7c6-d39ebe24faa1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:07.202757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:07.204128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:07.204428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:07.204773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] PATH_INFO: `/v3/users/4c1c2cf23adf4be9b7ea5ff1d7e4df51` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:07.217292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1c2cf23adf4be9b7ea5ff1d7e4df51)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:07.220067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:07.227067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:07.228042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:07.228624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:07.229191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:07.230589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:07.234558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:07.384263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 877/1786] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:07 2022] POST /identity/v3/projects => generated 369 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:07.390205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:07.496848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1c2cf23adf4be9b7ea5ff1d7e4df51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:07.497628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1c2cf23adf4be9b7ea5ff1d7e4df51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:07.498413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1c2cf23adf4be9b7ea5ff1d7e4df51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:07.545450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1c2cf23adf4be9b7ea5ff1d7e4df51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:07.559756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c044d051-add8-45ed-a7e9-df8a49f7d3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1c2cf23adf4be9b7ea5ff1d7e4df51'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:07.582671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a51607-89e6-4bd4-a827-227162ee4e6a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:07.594449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55b820-7874-4d78-882e-120c48491134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:07.596141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55b820-7874-4d78-882e-120c48491134 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:07.596430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55b820-7874-4d78-882e-120c48491134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:07.597832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55b820-7874-4d78-882e-120c48491134 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:07.599264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55b820-7874-4d78-882e-120c48491134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:07.604587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55b820-7874-4d78-882e-120c48491134 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:07.678292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 910/1787] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:07 2022] DELETE /identity/v3/users/4c1c2cf23adf4be9b7ea5ff1d7e4df51 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:07.680322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:07.681778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:07.682295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:07.739806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 878/1788] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:07 2022] POST /identity/v3/users => generated 291 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:07.748032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:07.749281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:07.751129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:07.838108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:07.840070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:07.872063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:07.875569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:07.945469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:07.957534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 879/1789] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:07.958860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:07.960429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:07.986309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438bbc6-88b2-4736-8763-145ee6b7e033 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:07.995138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:07.997074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:07.997074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:07.997328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:07.999678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:08.003297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:08.026698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 880/1790] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:08.026698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:08.029330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:08.063890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 911/1791] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:08.066176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:08.105884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54777f76-702b-4a28-b5c3-190e5391a2ea None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:08.120312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:08.121379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.121781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.122162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] PATH_INFO: `/v3/projects/7a3a1921e8ba4edf94174dd881717bd0/users/f23ec7f767ac4f7ead92e744b58b8dbe/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:08.137701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89365c5-56ae-4f25-b9f4-39515ec49cbf admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:08.142331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:08.143012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.143388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.144319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:08.158749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:08.160713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:08.161768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3a1921e8ba4edf94174dd881717bd0, user_id=f23ec7f767ac4f7ead92e744b58b8dbe, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:08.164887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:08.192652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:08.194632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 881/1792] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:08.369390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 912/1793] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:08 2022] PUT /identity/v3/projects/7a3a1921e8ba4edf94174dd881717bd0/users/f23ec7f767ac4f7ead92e744b58b8dbe/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:08.373554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:08.388174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ea64-fef4-431b-b271-46a47e169984 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:08.409175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:08.411220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:08.466437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:08.467136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.467625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.467990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:08.468949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:08.470719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:08.488154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 882/1794] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:08.489313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:08.502218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49dd6a-1750-49f4-bb8c-247a0dbbbf2b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:08.510106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374df63-f4d5-4356-9f2b-34e9b79f4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:08.511031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374df63-f4d5-4356-9f2b-34e9b79f4a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.512407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374df63-f4d5-4356-9f2b-34e9b79f4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.513637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374df63-f4d5-4356-9f2b-34e9b79f4a22 admin admin] PATH_INFO: `/v3/projects/7a3a1921e8ba4edf94174dd881717bd0/users/f23ec7f767ac4f7ead92e744b58b8dbe/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:08.519122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374df63-f4d5-4356-9f2b-34e9b79f4a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3a1921e8ba4edf94174dd881717bd0, user_id=f23ec7f767ac4f7ead92e744b58b8dbe, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:08.538141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374df63-f4d5-4356-9f2b-34e9b79f4a22 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:08.562025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 883/1795] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:08 2022] PUT /identity/v3/projects/7a3a1921e8ba4edf94174dd881717bd0/users/f23ec7f767ac4f7ead92e744b58b8dbe/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:08.577868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.579259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b067b-8098-4d45-bf0b-3e7d3adeb963 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:08.579713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.579713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:08.632300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:08.633573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:08.724961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 884/1796] 10.222.0.58 () {58 vars in 1015 bytes} [Mon Jul 25 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:08.725478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:08.726270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:08.726695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.727051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.727472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] PATH_INFO: `/v3/users/c427949a5de54eb79c0736b823a61bf6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:08.728314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:08.729480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c427949a5de54eb79c0736b823a61bf6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:08.731862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:08.934783 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15674ee5-5627-4f7c-8d70-0df032bedf8f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:08.943600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de2004-1258-4eb2-ae0a-897598a2db43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:08.944441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2004-1258-4eb2-ae0a-897598a2db43 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:08.944805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2004-1258-4eb2-ae0a-897598a2db43 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:08.945311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de2004-1258-4eb2-ae0a-897598a2db43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.033273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2004-1258-4eb2-ae0a-897598a2db43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:09.036339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de2004-1258-4eb2-ae0a-897598a2db43 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:09.066147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 885/1797] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:50:09.068858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:09.069904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:09.070205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.110566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] MFA Rules not processed for user `f23ec7f767ac4f7ead92e744b58b8dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:09.115675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:09.173298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c427949a5de54eb79c0736b823a61bf6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:09.176780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c427949a5de54eb79c0736b823a61bf6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:09.178679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c427949a5de54eb79c0736b823a61bf6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:09.225160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c427949a5de54eb79c0736b823a61bf6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:09.264735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c427949a5de54eb79c0736b823a61bf6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:09.264853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 886/1798] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:09.267537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:09.272719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:09.306298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756abe55-1456-427f-9816-e19ad1abdf8c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:09.312333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:09.313122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:09.313122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:09.320207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.332022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:09.363581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:09.365333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:09.395199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 887/1799] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:09.396391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:09.407980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:09.443791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 913/1800] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:08 2022] DELETE /identity/v3/users/c427949a5de54eb79c0736b823a61bf6 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:09.448077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:09.449111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:09.451483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b145dec-e418-4bb1-8ad4-ab02b2a46739 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:09.605198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d1de2-0fdc-4f9a-8c0c-cfb7807039d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:09.605906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1de2-0fdc-4f9a-8c0c-cfb7807039d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:09.606284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1de2-0fdc-4f9a-8c0c-cfb7807039d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:09.606560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d1de2-0fdc-4f9a-8c0c-cfb7807039d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.635447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d1de2-0fdc-4f9a-8c0c-cfb7807039d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:09.637036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d1de2-0fdc-4f9a-8c0c-cfb7807039d0 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:09.655199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 888/1801] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:09.658506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:09.658797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:09.659617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.670472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:09.717191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46834-5ad9-4278-8329-c3a9a1b45b3c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:09.726178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:09.727433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:09.755632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:09.756463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:09.756748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:09.757017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.874811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 889/1802] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:09.909975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:09.928728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240ba3b-121e-40f7-ab62-7448f32da39e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:09.933349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:09.934157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:09.934446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:09.934726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:09.956181 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:09.957680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:09.991478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 890/1803] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:10.009317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:10.020143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:10.024747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:10.026332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:10.060468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb66071-a94e-4d8a-b687-943646307b51 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:10.061839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 914/1804] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:10.069350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:10.070433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:10.070785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:10.070983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] PATH_INFO: `/v3/projects/205f4aed8ae743e486dafdf1e818bc22` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:10.072321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=205f4aed8ae743e486dafdf1e818bc22)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:10.076203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:10.239118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:10.265156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafcd15-eb8b-4f74-bc4f-e4e5b2c4338b service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:10.324871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:10.360204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205f4aed8ae743e486dafdf1e818bc22', 'request_id': 'req-115c3004-e2af-4e3d-9408-d9f9f34cd202'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:10.386669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:10.388075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:10.388582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:10.389045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:10.395398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205f4aed8ae743e486dafdf1e818bc22', 'request_id': 'req-115c3004-e2af-4e3d-9408-d9f9f34cd202'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:10.398194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:10.413226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205f4aed8ae743e486dafdf1e818bc22', 'request_id': 'req-115c3004-e2af-4e3d-9408-d9f9f34cd202'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:10.498665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:10.516581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:10.553324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 915/1805] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:10.903229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] The token cache is being invalidate because project 205f4aed8ae743e486dafdf1e818bc22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:10.903526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:10.908472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-115c3004-e2af-4e3d-9408-d9f9f34cd202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:10.910812 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 891/1806] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:10 2022] DELETE /identity/v3/projects/205f4aed8ae743e486dafdf1e818bc22 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:10.914865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:11.043461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb1bef8-810c-4d8d-838f-6c0494ae1643 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:11.049025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:11.050850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:11.051609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:11.052233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] PATH_INFO: `/v3/users/e41dcf32b1a44eea97bdee2c8d8683b4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:11.053792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41dcf32b1a44eea97bdee2c8d8683b4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:11.056164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:11.278544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:11.311168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41dcf32b1a44eea97bdee2c8d8683b4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:11.318628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41dcf32b1a44eea97bdee2c8d8683b4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:11.328375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41dcf32b1a44eea97bdee2c8d8683b4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:11.366751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41dcf32b1a44eea97bdee2c8d8683b4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:11.388593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4e489aaa-8639-4217-831b-bfea2450c78f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41dcf32b1a44eea97bdee2c8d8683b4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:11.483610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 916/1807] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:10 2022] DELETE /identity/v3/users/e41dcf32b1a44eea97bdee2c8d8683b4 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:11.911996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ccfc2-8524-46a1-a4fd-f2d907ed69ff None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:11.912529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ccfc2-8524-46a1-a4fd-f2d907ed69ff None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:11.912631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ccfc2-8524-46a1-a4fd-f2d907ed69ff None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:11.914282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 892/1808] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:50:12.124757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa63ef-00fa-4116-bca6-15309fc5b5cb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:12.125303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa63ef-00fa-4116-bca6-15309fc5b5cb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:12.125303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa63ef-00fa-4116-bca6-15309fc5b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:12.182608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5faa63ef-00fa-4116-bca6-15309fc5b5cb None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:12.200076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5faa63ef-00fa-4116-bca6-15309fc5b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:12.381040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 917/1809] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:12.630885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f15f-1408-4d98-ad1b-6dca2dd0013b None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:12.631175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f15f-1408-4d98-ad1b-6dca2dd0013b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:12.631647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f15f-1408-4d98-ad1b-6dca2dd0013b None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:12.633272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 893/1810] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:50:12.652509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:12.652700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:12.652984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:12.688253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:12.695104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:12.722103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 918/1811] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:12.927198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:13.312511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f15f-1408-4d98-ad1b-6dca2dd0013b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:13.316152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-86f3f15f-1408-4d98-ad1b-6dca2dd0013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:13.357473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f15f-1408-4d98-ad1b-6dca2dd0013b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:13.364364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:13.365399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:13.365857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:13.366328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:13.384308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:13.389090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:13.425761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 894/1812] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:13.483853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:13.494290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:13.495542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:13.497536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:13.520791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:13.566458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a851836-3710-4ca5-8f66-aac7afdc84bb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:13.594803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:13.596200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:13.598260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:13.600184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:13.640625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:13.643028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:13.682229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 919/1813] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:13.684422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:13.695661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:13.697748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ca3fb-b617-4432-8d0d-110e6b80ed0d service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:13.720324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:13.720324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:13.720324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:13.720324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] PATH_INFO: `/v3/projects/6cb605e8b5d44e36ae2fc10324deb630` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:13.721029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb605e8b5d44e36ae2fc10324deb630)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:13.749416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:13.754058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740be6c0-017e-408e-a654-a5fe65b5e813 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:13.772069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:13.773014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:13.773322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:13.773628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] PATH_INFO: `/v3/projects/7f62876c1698464d9446392d091d06de` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:13.781237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f62876c1698464d9446392d091d06de)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:13.789113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:14.019126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb605e8b5d44e36ae2fc10324deb630', 'request_id': 'req-a9962d1b-7677-438f-a565-f24f3fbef1bb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.021082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f62876c1698464d9446392d091d06de', 'request_id': 'req-77db9399-4050-45df-a69a-f8fb8556f740'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.032270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f62876c1698464d9446392d091d06de', 'request_id': 'req-77db9399-4050-45df-a69a-f8fb8556f740'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.057583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb605e8b5d44e36ae2fc10324deb630', 'request_id': 'req-a9962d1b-7677-438f-a565-f24f3fbef1bb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.071409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb605e8b5d44e36ae2fc10324deb630', 'request_id': 'req-a9962d1b-7677-438f-a565-f24f3fbef1bb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.193661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f62876c1698464d9446392d091d06de', 'request_id': 'req-77db9399-4050-45df-a69a-f8fb8556f740'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.224484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] The token cache is being invalidate because project 7f62876c1698464d9446392d091d06de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:14.225892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.232341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.234227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 920/1814] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:13 2022] DELETE /identity/v3/projects/7f62876c1698464d9446392d091d06de => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:14.250253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:14.252127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:14.282883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] The token cache is being invalidate because project 6cb605e8b5d44e36ae2fc10324deb630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:14.283184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.284535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a9962d1b-7677-438f-a565-f24f3fbef1bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.290337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 895/1815] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:13 2022] DELETE /identity/v3/projects/6cb605e8b5d44e36ae2fc10324deb630 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:14.305693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8e0b-0b9c-4ed2-a637-a11417e64780 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:14.306029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8e0b-0b9c-4ed2-a637-a11417e64780 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:14.312121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8e0b-0b9c-4ed2-a637-a11417e64780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:14.367246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9d6b8e0b-0b9c-4ed2-a637-a11417e64780 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:14.369131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9d6b8e0b-0b9c-4ed2-a637-a11417e64780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:14.425938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db9399-4050-45df-a69a-f8fb8556f740 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:14.433236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:14.434557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:14.435055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:14.435559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] PATH_INFO: `/v3/users/85da45f4e9e440b1984e86f32095c306` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:14.437226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=85da45f4e9e440b1984e86f32095c306)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:14.439836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:14.577756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 896/1816] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:14.586580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:14.592581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:14.592581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:14.593244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:14.656721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:14.663182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:14.685152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 897/1817] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:14.692366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:14.736582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85da45f4e9e440b1984e86f32095c306'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.747167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85da45f4e9e440b1984e86f32095c306'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.749354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85da45f4e9e440b1984e86f32095c306'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.755748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a45d7e6-410d-4d1a-981a-610fd4063e85 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:14.777225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:14.777990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:14.778329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:14.778606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:14.779414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:14.782155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:14.788614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:14.791761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85da45f4e9e440b1984e86f32095c306'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.809899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85da45f4e9e440b1984e86f32095c306'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:14.821868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 898/1818] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:14.826447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:14.829315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:14.882155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2a3a-a841-489d-bd04-11ae4cfd6ad8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:14.888252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:14.891033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:14.892139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:14.892711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:14.894767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:14.900126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:14.964832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 921/1819] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:14 2022] DELETE /identity/v3/users/85da45f4e9e440b1984e86f32095c306 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:15.062511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 899/1820] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:14 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:15.067398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:15.165024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1c7dd-d1c4-49bb-96df-59d676a6a1da admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:15.237075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:15.237899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:15.238194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:15.238486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:15.239269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:15.241284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:15.366630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 922/1821] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:15 2022] POST /identity/v3/users => generated 292 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:15.381346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:15.398634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef34fcb-9d15-432e-8ab8-7285c57726a4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:15.417803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:15.418501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:15.419138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:15.419629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:15.420489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:15.422426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:15.456632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 900/1822] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:15.459883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:15.475246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889b355-7e00-46a6-aa8d-034d5027f103 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:15.485431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680fcc9-5625-43f1-aa35-1e1b68105a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:15.486135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680fcc9-5625-43f1-aa35-1e1b68105a18 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:15.486421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680fcc9-5625-43f1-aa35-1e1b68105a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:15.486696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680fcc9-5625-43f1-aa35-1e1b68105a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:15.487969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680fcc9-5625-43f1-aa35-1e1b68105a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:15.489892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680fcc9-5625-43f1-aa35-1e1b68105a18 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:15.525752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 923/1823] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:15.536321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:15.552877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45be52-af98-4384-adde-beb3e8354561 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:15.566550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:15.574706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:15.574706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:15.574706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] PATH_INFO: `/v3/projects/2c97b13f29ef4824a389ebb4ffe5e2c4/users/353a1c53644945dd922452eef860d664/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:15.601618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c97b13f29ef4824a389ebb4ffe5e2c4, user_id=353a1c53644945dd922452eef860d664, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:15.604998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:15.748230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 901/1824] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:15 2022] PUT /identity/v3/projects/2c97b13f29ef4824a389ebb4ffe5e2c4/users/353a1c53644945dd922452eef860d664/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:15.750686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:15.751300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:15.751300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:15.813709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] MFA Rules not processed for user `353a1c53644945dd922452eef860d664`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:15.815649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:15.923901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:15.925901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:15.962972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 924/1825] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:15.968540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:16.133620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ffd54-ca21-4f59-b103-734a378a06e9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.141232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.142576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.143626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.144164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] PATH_INFO: `/v3/projects/e1250244af5743f2967fbbfc20460f21` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.152133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1250244af5743f2967fbbfc20460f21)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.159267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:16.163078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.223254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad8d20-95b4-42b6-bd84-1fb49685fdd2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.254605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.258193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.258685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.261055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.263639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.270816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.377007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1250244af5743f2967fbbfc20460f21', 'request_id': 'req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:16.391848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1250244af5743f2967fbbfc20460f21', 'request_id': 'req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:16.403412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1250244af5743f2967fbbfc20460f21', 'request_id': 'req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:16.444287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 925/1826] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:15 2022] POST /identity/v3/projects => generated 381 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:16.449154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:16.515495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] The token cache is being invalidate because project e1250244af5743f2967fbbfc20460f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:16.516006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:16.517665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6aaad9da-a7ee-43ad-8074-36fe8fbc12f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:16.527379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 902/1827] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:15 2022] DELETE /identity/v3/projects/e1250244af5743f2967fbbfc20460f21 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:16.529420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7698c-3bb3-464a-b67d-9f8715748e18 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.529780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7698c-3bb3-464a-b67d-9f8715748e18 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.530529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7698c-3bb3-464a-b67d-9f8715748e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.537694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:16.591164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c0d7698c-3bb3-464a-b67d-9f8715748e18 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:16.595736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c0d7698c-3bb3-464a-b67d-9f8715748e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:16.603001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb49416-db87-4c09-a1b9-032f93d8f994 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.616416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.617370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.617650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.617928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.618631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.620814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.621642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 903/1828] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:16.633610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.633610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.633610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.654365 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:16.656208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:16.670045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 904/1829] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:16.671304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:16.683894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b989f-3f35-43d2-b160-34978ebbdb6a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.691122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.692827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.694036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.694481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.705114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:16.706180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.709271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.726638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 905/1830] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:16.732258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:16.762450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571df73-5f21-4afd-ab8e-fca23d2b4a6c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.767853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 926/1831] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:16 2022] POST /identity/v3/users => generated 297 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:16.773487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:16.782598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:16.787587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.788316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.790607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.790607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.790607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.791486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.803392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833c033-ede4-49fc-8bcf-ae3e0992427b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.810992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.812407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.812779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.813059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.814092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.818625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.828279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 927/1832] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:16.838217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:16.863355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43893976-5962-4f9c-81c2-d2e142e84739 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:16.874742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:16.875943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:16.876272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:16.876584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] PATH_INFO: `/v3/projects/89c4618aa56d4a698bcb46fbe0b9bbfa/users/a11844bd39254eb0abb716ea188f1af6/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:16.910709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c4618aa56d4a698bcb46fbe0b9bbfa, user_id=a11844bd39254eb0abb716ea188f1af6, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:16.916543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:16.950706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 906/1833] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:16 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:16.954769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.048436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061dfd9-b26e-4aec-a44b-ecc4a9744e89 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.055104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.063262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.063262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.063262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.063262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.063262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.063636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 928/1834] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:16 2022] PUT /identity/v3/projects/89c4618aa56d4a698bcb46fbe0b9bbfa/users/a11844bd39254eb0abb716ea188f1af6/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:17.065747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.179912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fb9b7-c6c8-472c-a8df-65adbc503c0e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.187575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.188473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.188857 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.189136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.189704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 907/1835] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:16 2022] POST /identity/v3/users => generated 301 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:17.190601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.192599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.195115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.210262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 929/1836] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:17.210520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efbf5e-735e-4ee9-8778-af2af0987e55 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.219565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.220271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.220575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.220903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.222976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.225022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.226063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.246633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c235ba-a415-4322-93c4-340c737a672e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.250036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 908/1837] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:17.262082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.269217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f481c4-2fc3-4311-8b1b-f91befca9a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.270286 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f481c4-2fc3-4311-8b1b-f91befca9a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.271091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f481c4-2fc3-4311-8b1b-f91befca9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.271451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f481c4-2fc3-4311-8b1b-f91befca9a88 admin admin] PATH_INFO: `/v3/projects/89c4618aa56d4a698bcb46fbe0b9bbfa/users/a11844bd39254eb0abb716ea188f1af6/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.276771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f481c4-2fc3-4311-8b1b-f91befca9a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c4618aa56d4a698bcb46fbe0b9bbfa, user_id=a11844bd39254eb0abb716ea188f1af6, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.277995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f481c4-2fc3-4311-8b1b-f91befca9a88 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.282662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa5f15-9af6-4ac5-b2db-c1989ffda8ed admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.290478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 930/1838] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:17 2022] PUT /identity/v3/projects/89c4618aa56d4a698bcb46fbe0b9bbfa/users/a11844bd39254eb0abb716ea188f1af6/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:17.302045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.305229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.305747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.373915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] MFA Rules not processed for user `a11844bd39254eb0abb716ea188f1af6`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:17.375579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:17.388435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.389404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.389750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.390087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.390834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.392636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.408012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 909/1839] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:17.413818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.423326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05caee-a829-44ee-84e7-119970cb359b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.431011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6566a34-445d-4b3e-93ad-33b7f627bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.431957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6566a34-445d-4b3e-93ad-33b7f627bafd admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.432254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6566a34-445d-4b3e-93ad-33b7f627bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.432541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6566a34-445d-4b3e-93ad-33b7f627bafd admin admin] PATH_INFO: `/v3/projects/ec4adf5dc87f4cecbedb237c9c23c8e0/users/bdf7f4ef34484f67b9a095755c333591/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.450386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6566a34-445d-4b3e-93ad-33b7f627bafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4adf5dc87f4cecbedb237c9c23c8e0, user_id=bdf7f4ef34484f67b9a095755c333591, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.453537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6566a34-445d-4b3e-93ad-33b7f627bafd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.483048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 931/1840] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:17.526413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.527860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:17.564026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 910/1841] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:17 2022] PUT /identity/v3/projects/ec4adf5dc87f4cecbedb237c9c23c8e0/users/bdf7f4ef34484f67b9a095755c333591/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:17.574873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.575163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.575444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.623620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78c6a0-c2d1-4424-9013-af49e5146d1a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.626778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] MFA Rules not processed for user `bdf7f4ef34484f67b9a095755c333591`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:17.631639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:17.693167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.693859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.694143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.694417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.746158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 911/1842] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:17.748832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:17.850212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.862618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:17.889834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 932/1843] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:17.923791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab17e5-ec9d-4778-9249-b1ba5f8fa2cc None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:17.934454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:17.935143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:17.935581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:17.935865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:17.936604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:17.938543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:18.071006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 912/1844] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:17 2022] POST /identity/v3/projects => generated 399 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:18.075739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:18.101193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad96120-3095-4b91-af6c-c5b4f973c620 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:18.193663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:18.194505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:18.194715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:18.194979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:18.196087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:18.199382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:18.286324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:18.290828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:18.311352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a4536-baa0-4868-af30-f16f35b18dd7 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:18.314271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 933/1845] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:18 2022] POST /identity/v3/users => generated 306 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:18.315227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:18.325031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:18.325948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:18.326292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:18.326596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] PATH_INFO: `/v3/users/aba7f1f9ebbc4b1dbdfc467b1eb93f25` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:18.328002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba7f1f9ebbc4b1dbdfc467b1eb93f25)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:18.332656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:18.435963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0de1b6-56a6-4b64-aee7-4de30b2df40c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:18.440399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:18.441246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:18.441786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:18.442077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:18.444251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:18.527092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:18.528597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:18.540832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 934/1846] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:18.541633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:18.543396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:18.544182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba7f1f9ebbc4b1dbdfc467b1eb93f25'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.546446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba7f1f9ebbc4b1dbdfc467b1eb93f25'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.549605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba7f1f9ebbc4b1dbdfc467b1eb93f25'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.558039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684a2fb-c594-46e5-b770-ec9ab687f7bd service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:18.567701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:18.570991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba7f1f9ebbc4b1dbdfc467b1eb93f25'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.571144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:18.571398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:18.571668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] PATH_INFO: `/v3/users/d85a9daf56874fa5aa8b085ac1d0169f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:18.576705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85a9daf56874fa5aa8b085ac1d0169f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:18.582502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:18.582976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba7f1f9ebbc4b1dbdfc467b1eb93f25'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.706108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 913/1847] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:18 2022] DELETE /identity/v3/users/aba7f1f9ebbc4b1dbdfc467b1eb93f25 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:18.707750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:18.709907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:18.825616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85a9daf56874fa5aa8b085ac1d0169f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.829776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85a9daf56874fa5aa8b085ac1d0169f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.831314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85a9daf56874fa5aa8b085ac1d0169f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.834891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d346-da25-4a0e-8c35-03771c99fe43 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:18.857499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b7d1f-fdc9-4506-bd6d-812d2db65ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:18.858855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b7d1f-fdc9-4506-bd6d-812d2db65ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:18.859208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b7d1f-fdc9-4506-bd6d-812d2db65ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:18.859932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b7d1f-fdc9-4506-bd6d-812d2db65ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:18.861165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b7d1f-fdc9-4506-bd6d-812d2db65ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:18.864711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85a9daf56874fa5aa8b085ac1d0169f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.865253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b7d1f-fdc9-4506-bd6d-812d2db65ee3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:18.882784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a0a89425-439b-41b6-af58-80275a0d53e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85a9daf56874fa5aa8b085ac1d0169f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:18.886329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 914/1848] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:18.891885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:18.892299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:18.892685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:18.962092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:18.962092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:18.982260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 915/1849] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:18.983418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:18.985006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:18.991074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 935/1850] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:18 2022] DELETE /identity/v3/users/d85a9daf56874fa5aa8b085ac1d0169f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:19.000463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5b4b4-42b3-4c4b-a413-d53c19e463db None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.001788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.002102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.002421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.031501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:19.032935 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:19.090375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.091541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.091996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.092478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] PATH_INFO: `/v3/projects/1bc2f4f6fe10474987af3053616903e6/users/dbc6dc9f0a3549c1b173b45a118c1124/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.120483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc2f4f6fe10474987af3053616903e6, user_id=dbc6dc9f0a3549c1b173b45a118c1124, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.130414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.150253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 936/1851] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:19.150253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:19.150661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:19.234404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 916/1852] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:18 2022] PUT /identity/v3/projects/1bc2f4f6fe10474987af3053616903e6/users/dbc6dc9f0a3549c1b173b45a118c1124/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:19.234404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:19.242931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:19.246736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5c6a7-003e-412b-bb79-cf042fea0165 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.271514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:19.337836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.338505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.338835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.339117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.347086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081d773-df70-441c-80a0-b69ec5558b35 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.361201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.362021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.362309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.362843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.448853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.452586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.471418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 937/1853] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:19.474220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:19.490156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f348-d35e-4529-80a9-e40a38a21930 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.497756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.499222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.499809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.508162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.509793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.511569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.517982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.520587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.525448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 938/1854] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:19.526455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:19.538074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:19.538918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 917/1855] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:19.540369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:19.564066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61157c4-411f-4308-8428-b41fe670e0be service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.567933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24dda6-ba06-46e9-8d13-ce9e403816e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.569449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24dda6-ba06-46e9-8d13-ce9e403816e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.569838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24dda6-ba06-46e9-8d13-ce9e403816e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.570253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24dda6-ba06-46e9-8d13-ce9e403816e5 admin admin] PATH_INFO: `/v3/projects/1bc2f4f6fe10474987af3053616903e6/users/dbc6dc9f0a3549c1b173b45a118c1124/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.575502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24dda6-ba06-46e9-8d13-ce9e403816e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc2f4f6fe10474987af3053616903e6, user_id=dbc6dc9f0a3549c1b173b45a118c1124, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.578327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd82ad-15fa-4b0c-9497-8f7960f67811 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.580227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24dda6-ba06-46e9-8d13-ce9e403816e5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.600449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 918/1856] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:19 2022] PUT /identity/v3/projects/1bc2f4f6fe10474987af3053616903e6/users/dbc6dc9f0a3549c1b173b45a118c1124/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:19.604961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.605867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.606152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.607105 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] PATH_INFO: `/v3/users/353a1c53644945dd922452eef860d664` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.619103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] RBAC: Authorizing `identity:delete_user(user_id=353a1c53644945dd922452eef860d664)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.619715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.619999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.620289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.621593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.659990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] MFA Rules not processed for user `dbc6dc9f0a3549c1b173b45a118c1124`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:19.661316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:19.797486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 919/1857] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:19.816860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:19.818636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:19.928279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d861e-8b47-436b-ab7e-8db79d7a7117 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:19.940165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ae93a-411d-4a4e-b78c-78faf7eee160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:19.947367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ae93a-411d-4a4e-b78c-78faf7eee160 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:19.947367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ae93a-411d-4a4e-b78c-78faf7eee160 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:19.947367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ae93a-411d-4a4e-b78c-78faf7eee160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:19.957621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ae93a-411d-4a4e-b78c-78faf7eee160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:19.959629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ae93a-411d-4a4e-b78c-78faf7eee160 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:19.968786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353a1c53644945dd922452eef860d664'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:19.970284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353a1c53644945dd922452eef860d664'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:19.971716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353a1c53644945dd922452eef860d664'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:19.985213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 920/1858] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:20.015155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353a1c53644945dd922452eef860d664'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.034690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353a1c53644945dd922452eef860d664'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.350041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 939/1859] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:19 2022] DELETE /identity/v3/users/353a1c53644945dd922452eef860d664 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:20.359362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:20.359837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:20.364002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:20.389951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:20.391166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.465189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 921/1860] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:20.475727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:20.477206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.542202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:20.552029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.552312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b77e3-625f-4353-9cdb-c41bb079b84a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:20.553112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:20.554122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:20.554319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:20.554539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:20.576882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:20.578404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:20.594481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 940/1861] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:20.595346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:20.597486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.613173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f416d-f10c-4b4e-a6d9-5b88cd1120ba service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:20.619304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:20.620374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:20.620735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:20.621212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] PATH_INFO: `/v3/projects/d38089e359a244759a8c2f666d118579` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:20.622675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38089e359a244759a8c2f666d118579)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:20.624911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:20.627700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d29d7-c2de-4b96-acb3-7b7b62d5fa55 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:20.631546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:20.632391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:20.632626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:20.633026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:20.634880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.725238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:20.726343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:20.738823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 922/1862] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:20.784119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:20.786566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.791048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38089e359a244759a8c2f666d118579', 'request_id': 'req-1fb39205-39ba-4c97-a05f-b708f173c706'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.797904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38089e359a244759a8c2f666d118579', 'request_id': 'req-1fb39205-39ba-4c97-a05f-b708f173c706'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.806969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a2fe5-63db-459c-bee1-b037b420ccd7 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:20.875259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38089e359a244759a8c2f666d118579', 'request_id': 'req-1fb39205-39ba-4c97-a05f-b708f173c706'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.890134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] The token cache is being invalidate because project d38089e359a244759a8c2f666d118579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:20.890648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.891608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:20.894219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 941/1863] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:20 2022] DELETE /identity/v3/projects/d38089e359a244759a8c2f666d118579 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:20.898294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:20.900813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:20.914579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:20.915456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:20.916265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:20.916265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] PATH_INFO: `/v3/projects/c298b82f2e764a8e9f2dcf524eb7f0e4` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:20.917336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c298b82f2e764a8e9f2dcf524eb7f0e4)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:20.919262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:20.969660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39205-39ba-4c97-a05f-b708f173c706 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:20.975076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:20.979704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:20.979704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:20.979704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] PATH_INFO: `/v3/users/3176f08c95aa46139c9e72bc1044c6ca` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:20.979704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3176f08c95aa46139c9e72bc1044c6ca)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:20.979704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:21.072053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c298b82f2e764a8e9f2dcf524eb7f0e4', 'request_id': 'req-588a88ba-f646-4b8f-9be0-564607c53dc3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.083436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c298b82f2e764a8e9f2dcf524eb7f0e4', 'request_id': 'req-588a88ba-f646-4b8f-9be0-564607c53dc3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.098307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c298b82f2e764a8e9f2dcf524eb7f0e4', 'request_id': 'req-588a88ba-f646-4b8f-9be0-564607c53dc3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.217107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] The token cache is being invalidate because project c298b82f2e764a8e9f2dcf524eb7f0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:21.217403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.224115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.227436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 923/1864] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:20 2022] DELETE /identity/v3/projects/c298b82f2e764a8e9f2dcf524eb7f0e4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:21.233585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:21.235184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:21.293914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3176f08c95aa46139c9e72bc1044c6ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.293914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3176f08c95aa46139c9e72bc1044c6ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.293914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3176f08c95aa46139c9e72bc1044c6ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.302365 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a88ba-f646-4b8f-9be0-564607c53dc3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:21.305409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3176f08c95aa46139c9e72bc1044c6ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.307194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:21.308115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:21.308391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:21.308661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] PATH_INFO: `/v3/users/f23ec7f767ac4f7ead92e744b58b8dbe` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:21.309901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23ec7f767ac4f7ead92e744b58b8dbe)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:21.311980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:21.316929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3176f08c95aa46139c9e72bc1044c6ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.409724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 942/1865] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:20 2022] DELETE /identity/v3/users/3176f08c95aa46139c9e72bc1044c6ca => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:21.413169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:21.414661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:21.446266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:21.485011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0fb0-62b2-42b5-a2a8-1d4aaf9e8212 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:21.490059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:21.491121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:21.491500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:21.492071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] PATH_INFO: `/v3/projects/2c97b13f29ef4824a389ebb4ffe5e2c4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:21.493279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c97b13f29ef4824a389ebb4ffe5e2c4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:21.495243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:21.519694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23ec7f767ac4f7ead92e744b58b8dbe'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.520414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23ec7f767ac4f7ead92e744b58b8dbe'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.521048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23ec7f767ac4f7ead92e744b58b8dbe'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.540570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23ec7f767ac4f7ead92e744b58b8dbe'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.548536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23ec7f767ac4f7ead92e744b58b8dbe'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.645722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c97b13f29ef4824a389ebb4ffe5e2c4', 'request_id': 'req-d46b78d7-5713-455d-8dcf-6dab569f789a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.651610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c97b13f29ef4824a389ebb4ffe5e2c4', 'request_id': 'req-d46b78d7-5713-455d-8dcf-6dab569f789a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.658458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 924/1866] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:21 2022] DELETE /identity/v3/users/f23ec7f767ac4f7ead92e744b58b8dbe => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:21.775878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c97b13f29ef4824a389ebb4ffe5e2c4', 'request_id': 'req-d46b78d7-5713-455d-8dcf-6dab569f789a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.791194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] The token cache is being invalidate because project 2c97b13f29ef4824a389ebb4ffe5e2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:21.791529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.792625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:21.796165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 943/1867] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:21 2022] DELETE /identity/v3/projects/2c97b13f29ef4824a389ebb4ffe5e2c4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:21.798705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:21.801518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:21.876638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e626f-d4ec-4e0b-becb-5903f2973bdd admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:21.882080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:21.882983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:21.886878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:21.886878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] PATH_INFO: `/v3/users/a11844bd39254eb0abb716ea188f1af6` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:21.886878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11844bd39254eb0abb716ea188f1af6)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:21.886878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.027764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.029266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:22.117496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b78d7-5713-455d-8dcf-6dab569f789a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:22.123653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:22.125047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.132632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.132632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] PATH_INFO: `/v3/projects/3420c22779954c66844525749b76eba7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.132632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3420c22779954c66844525749b76eba7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:22.132632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.178260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11844bd39254eb0abb716ea188f1af6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.179087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11844bd39254eb0abb716ea188f1af6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.179873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11844bd39254eb0abb716ea188f1af6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.193697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11844bd39254eb0abb716ea188f1af6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.201023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11844bd39254eb0abb716ea188f1af6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.316176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3420c22779954c66844525749b76eba7', 'request_id': 'req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.324888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3420c22779954c66844525749b76eba7', 'request_id': 'req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.392781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 925/1868] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:21 2022] DELETE /identity/v3/users/a11844bd39254eb0abb716ea188f1af6 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:22.396362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.396362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:22.482718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b82b98-9aaf-4946-b9cc-0c33f5710509 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:22.488215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:22.489266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.489551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.489831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] PATH_INFO: `/v3/projects/7a3a1921e8ba4edf94174dd881717bd0` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.491182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3a1921e8ba4edf94174dd881717bd0)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:22.493437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.520382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3420c22779954c66844525749b76eba7', 'request_id': 'req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.534761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] The token cache is being invalidate because project 3420c22779954c66844525749b76eba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:22.535054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.535721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1615c7ae-dff1-4d9d-a665-46dd1ce6b630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.537373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 944/1869] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:22 2022] DELETE /identity/v3/projects/3420c22779954c66844525749b76eba7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:22.541817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9c6b2-8798-461d-9513-c0e9b1b23510 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.542175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9c6b2-8798-461d-9513-c0e9b1b23510 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.542454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9c6b2-8798-461d-9513-c0e9b1b23510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.562449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8cd9c6b2-8798-461d-9513-c0e9b1b23510 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:22.563637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8cd9c6b2-8798-461d-9513-c0e9b1b23510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:22.572230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 945/1870] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:22.579737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.580081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.580458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.599261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:22.600473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:22.611118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 946/1871] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:22.616273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.629730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bcc1e-c669-42d5-b468-bded78e4248c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:22.631763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3a1921e8ba4edf94174dd881717bd0', 'request_id': 'req-00b46ac1-0f09-4c69-a020-b54f1e102ca0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.641264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3a1921e8ba4edf94174dd881717bd0', 'request_id': 'req-00b46ac1-0f09-4c69-a020-b54f1e102ca0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.654272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3a1921e8ba4edf94174dd881717bd0', 'request_id': 'req-00b46ac1-0f09-4c69-a020-b54f1e102ca0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.702290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:22.703032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.703324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.703601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.711699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:22.711699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:22.711699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.730655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 947/1872] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:22.734651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.747704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ce100-34f8-4923-8afe-891269be7e99 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:22.755211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:22.756262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.756665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.757081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.757931 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:22.760217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.775741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] The token cache is being invalidate because project 7a3a1921e8ba4edf94174dd881717bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:22.776403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.788637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-00b46ac1-0f09-4c69-a020-b54f1e102ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:22.793885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 926/1873] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:22 2022] DELETE /identity/v3/projects/7a3a1921e8ba4edf94174dd881717bd0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:22.804194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35048ed-7978-410c-bc5a-3fb15e0b4cb8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.804194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35048ed-7978-410c-bc5a-3fb15e0b4cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.804194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35048ed-7978-410c-bc5a-3fb15e0b4cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.833394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d35048ed-7978-410c-bc5a-3fb15e0b4cb8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:22.834926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d35048ed-7978-410c-bc5a-3fb15e0b4cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:22.850889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 927/1874] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:22.852784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.852784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.853189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.873973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:22.875206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:22.884505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 928/1875] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:22.888627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.898544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1273c-6ec4-4fe6-a751-dd110f3928dd None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:22.903302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:22.903992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.904281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.904562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.905384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:22.905701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:22.907357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.920297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 929/1876] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:22.925308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.934956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6cc2e-8ee1-42f8-a83f-2ad1e7812999 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:22.939636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:22.950313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:22.950313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:22.950313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:22.950313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:22.950313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:22.950740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 948/1877] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:22.953205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:22.954867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.034265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92fd88-6b79-49a5-8f30-d471aa179acf admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.034265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.034265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.034265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.035437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.035437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.036765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.059481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 930/1878] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:23.060371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.062070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.128455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710f5f9-3be0-4f56-ad6d-eeb97bde2b59 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.134254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.135292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.135660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.136161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] PATH_INFO: `/v3/projects/89c4618aa56d4a698bcb46fbe0b9bbfa` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.139042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c4618aa56d4a698bcb46fbe0b9bbfa)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.140267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.146211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 949/1879] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:22 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:23.147505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.160877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80e76-f906-45c7-9a8e-2487f8d5d974 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.166098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.166762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.167046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.167323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.168046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.170014 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.270511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 950/1880] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:23.271949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.281344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c4618aa56d4a698bcb46fbe0b9bbfa', 'request_id': 'req-e114222d-ae9a-4e36-b433-4f37e27f7933'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:23.286281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22b2cb-2a19-4b42-8a2e-23130f5a1c2c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.288186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c4618aa56d4a698bcb46fbe0b9bbfa', 'request_id': 'req-e114222d-ae9a-4e36-b433-4f37e27f7933'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:23.295615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c4618aa56d4a698bcb46fbe0b9bbfa', 'request_id': 'req-e114222d-ae9a-4e36-b433-4f37e27f7933'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:23.344159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.344786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.345066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.345338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.346767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.348415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.358087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 951/1881] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:23.359082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.371694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fae67-d0ce-42a2-aaad-e53cb30de4c8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.377652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.377652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.377652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.377652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.378237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.379825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.397035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 952/1882] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:23.397887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] The token cache is being invalidate because project 89c4618aa56d4a698bcb46fbe0b9bbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:23.397999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.398651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:23.405473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:23.405473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 931/1883] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:23 2022] DELETE /identity/v3/projects/89c4618aa56d4a698bcb46fbe0b9bbfa => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:23.405473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.405473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.411185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cabda-37a3-4079-a015-e2374cdb2c22 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.416155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c319db-a9b4-4c9d-8b5f-bad77a953616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.416907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c319db-a9b4-4c9d-8b5f-bad77a953616 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.417195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c319db-a9b4-4c9d-8b5f-bad77a953616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.417476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c319db-a9b4-4c9d-8b5f-bad77a953616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.418207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c319db-a9b4-4c9d-8b5f-bad77a953616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.420078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c319db-a9b4-4c9d-8b5f-bad77a953616 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.433826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114222d-ae9a-4e36-b433-4f37e27f7933 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.436007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 953/1884] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:23.437386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.437677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.437946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.442340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.443000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.443280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.443569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.444496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.446234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.460930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 932/1885] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:23.460930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.462909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.464884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:23.467508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.476617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b50784-0f0b-400e-a9ca-9ce3aa6f9194 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.479081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 954/1886] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:23.480111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.484190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab3be8-c8c0-4197-812c-582c4dcd0462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.484871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3be8-c8c0-4197-812c-582c4dcd0462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.485435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3be8-c8c0-4197-812c-582c4dcd0462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.486177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab3be8-c8c0-4197-812c-582c4dcd0462 admin admin] PATH_INFO: `/v3/projects/5b3278be78894d96895b418658bc2a0a/users/5d27f069c2b341a8b0c1812d7cfe33ca/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.496528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831d61-67fc-406f-857b-1de8e27127df None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.503343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380408f-b011-4c18-b810-3d07fedb16c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.504304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380408f-b011-4c18-b810-3d07fedb16c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.504598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380408f-b011-4c18-b810-3d07fedb16c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.504796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3be8-c8c0-4197-812c-582c4dcd0462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3278be78894d96895b418658bc2a0a, user_id=5d27f069c2b341a8b0c1812d7cfe33ca, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.504914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380408f-b011-4c18-b810-3d07fedb16c1 admin admin] PATH_INFO: `/v3/projects/113851356e914ed193ec2f163b998fdd/users/771a4438846742d9b1e2fe57b265dd08/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.508205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab3be8-c8c0-4197-812c-582c4dcd0462 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.522098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:23.526279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380408f-b011-4c18-b810-3d07fedb16c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113851356e914ed193ec2f163b998fdd, user_id=771a4438846742d9b1e2fe57b265dd08, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.529209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380408f-b011-4c18-b810-3d07fedb16c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.611676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 933/1887] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:23 2022] PUT /identity/v3/projects/5b3278be78894d96895b418658bc2a0a/users/5d27f069c2b341a8b0c1812d7cfe33ca/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:23.613387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869f6b-7aa4-49ca-abb4-a54255d9c809 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.613763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869f6b-7aa4-49ca-abb4-a54255d9c809 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.614158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2869f6b-7aa4-49ca-abb4-a54255d9c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.637089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 955/1888] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:23 2022] PUT /identity/v3/projects/113851356e914ed193ec2f163b998fdd/users/771a4438846742d9b1e2fe57b265dd08/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:23.640628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.640628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.640628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.644052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d2869f6b-7aa4-49ca-abb4-a54255d9c809 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:23.645384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d2869f6b-7aa4-49ca-abb4-a54255d9c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.681342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] MFA Rules not processed for user `5d27f069c2b341a8b0c1812d7cfe33ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:23.688037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.754820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 934/1889] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:23.754820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.754820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.754820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.773283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 956/1890] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:23.776219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.782354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] MFA Rules not processed for user `771a4438846742d9b1e2fe57b265dd08`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:23.783727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:23.789850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0869e-41de-4d9a-a40a-9ccd3af96d25 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.795659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.796447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.796735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.797173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.797915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:23.798224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.800007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.821519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 957/1891] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:23.822635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.837377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d35ec2-4424-474b-a482-5313f6a221a4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.842332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.842983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.843266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.843543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.844412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.851627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.874936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 935/1892] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:23.875777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:23.887830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74f957-25c1-4b87-8584-c57b02dcec06 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:23.893188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:23.894309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:23.894621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:23.894905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:23.895678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:23.897619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:23.978669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 958/1893] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:23.979477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.042325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b46b5-2ccb-4e81-a0d6-46a58ba0ba00 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.047907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.049300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.049793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.050294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.051018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.053229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.053907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 936/1894] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:24.061735 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.126269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c91f8-1679-4ca9-9d51-1bd65b7cf426 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.131556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.132262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.132547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.132824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.133540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.135462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.203500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 959/1895] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:23 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:24.203500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.228996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 937/1896] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:24 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:24.230170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.242126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284a88c-2bb2-4391-b408-6fe403c0e1e8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.267647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea816b6-aefe-4899-8d99-37cbafa1f005 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.272380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.273089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.273370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.273642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.274385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.276331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.299821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.300525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.300810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.301108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.301834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.303776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.387118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 960/1897] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:24 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:24.387118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.393803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5a08-a957-46ac-9970-17bf19be4d16 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.398410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.399046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.399325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.399599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.400362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.401954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.413056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 961/1898] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:24.417369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 938/1899] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:24 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:24.417536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.417671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.427007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d55e8-7c2f-4375-9d54-ed2dc683851a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.428113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf92da-f271-4f67-9271-b9b1ce37a8cd admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.431810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.432518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.432656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.432849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.433124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.433455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.433762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.433866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.434038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] PATH_INFO: `/v3/projects/572796981a6740079d028d138a285d55/users/f14b12069e184d23946f392d6c8f9751/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.435420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.445694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 962/1900] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:24.446497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.451207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=572796981a6740079d028d138a285d55, user_id=f14b12069e184d23946f392d6c8f9751, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.454002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.457934 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b40d5-929a-4a71-a7d2-94381240e0e5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.462537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.463188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.463469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.463786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.464534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.466155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.478752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 963/1901] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:24.479794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.481435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:24.492133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7883a8-3407-424e-89a5-e18793149617 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.496764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.497403 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.497687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.497964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.498678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.500301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.510096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 964/1902] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:24.510850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.520185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265177e-c806-445b-ab89-a1033a502c53 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.524855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.525722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.526103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.526282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] PATH_INFO: `/v3/projects/b59070ac2c0d4bea9a187a73fb4d7d7a/users/ad00f9dad20a402d99de79444e838d1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.546079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59070ac2c0d4bea9a187a73fb4d7d7a, user_id=ad00f9dad20a402d99de79444e838d1f, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.547172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.564284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 939/1903] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:24 2022] PUT /identity/v3/projects/572796981a6740079d028d138a285d55/users/f14b12069e184d23946f392d6c8f9751/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:24.565649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.643519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:24.653183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 965/1904] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:24 2022] PUT /identity/v3/projects/b59070ac2c0d4bea9a187a73fb4d7d7a/users/ad00f9dad20a402d99de79444e838d1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:24.654227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.678600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f8f0-5911-4eee-8024-acd0135ff1da admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.803892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7b6b0-57ce-49c5-b0ad-336ab2b03b65 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.819284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.820858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.821325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.821805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] PATH_INFO: `/v3/projects/81027d6d00f343eabc718dd33a0eb32a/users/4d5bdcee010148119ed457a154b53bdc/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.824533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.825458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.825877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.826296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.827238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.829611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.851252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81027d6d00f343eabc718dd33a0eb32a, user_id=4d5bdcee010148119ed457a154b53bdc, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.856640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.857097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 966/1905] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:24.858131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.875123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc7405-63f6-495b-b191-fbc1e502ef3c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.881952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.883613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.884179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.884603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.885684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.887465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:24.906022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 967/1906] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:24.906022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:24.924910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2ddb1-9c9c-4da4-b26b-58c626b80d55 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:24.946247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556bdf2-c42b-4169-8fbb-f26ec6934435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:24.947351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bdf2-c42b-4169-8fbb-f26ec6934435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:24.947754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bdf2-c42b-4169-8fbb-f26ec6934435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:24.948199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556bdf2-c42b-4169-8fbb-f26ec6934435 admin admin] PATH_INFO: `/v3/projects/572796981a6740079d028d138a285d55/users/f14b12069e184d23946f392d6c8f9751/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:24.954299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556bdf2-c42b-4169-8fbb-f26ec6934435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=572796981a6740079d028d138a285d55, user_id=f14b12069e184d23946f392d6c8f9751, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:24.964821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556bdf2-c42b-4169-8fbb-f26ec6934435 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:25.004026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 940/1907] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:24 2022] PUT /identity/v3/projects/81027d6d00f343eabc718dd33a0eb32a/users/4d5bdcee010148119ed457a154b53bdc/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:25.020676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:25.032029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 968/1908] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:24 2022] PUT /identity/v3/projects/572796981a6740079d028d138a285d55/users/f14b12069e184d23946f392d6c8f9751/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:25.033736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92b88b-d422-4e09-8111-1100beffff4e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.034019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92b88b-d422-4e09-8111-1100beffff4e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.034299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92b88b-d422-4e09-8111-1100beffff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.075282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3b92b88b-d422-4e09-8111-1100beffff4e None None] MFA Rules not processed for user `4d5bdcee010148119ed457a154b53bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:25.078066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b92b88b-d422-4e09-8111-1100beffff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:25.183073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea533-3bd3-4aff-a6ca-220c79160c6c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:25.196991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 969/1909] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:25.196991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b465-b6c5-4391-b114-2dd341eea69f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.196991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b465-b6c5-4391-b114-2dd341eea69f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.196991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3b465-b6c5-4391-b114-2dd341eea69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.232843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5eb3b465-b6c5-4391-b114-2dd341eea69f None None] MFA Rules not processed for user `f14b12069e184d23946f392d6c8f9751`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:25.234074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5eb3b465-b6c5-4391-b114-2dd341eea69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:25.268291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:25.269198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.269480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.269751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] PATH_INFO: `/v3/projects/b59070ac2c0d4bea9a187a73fb4d7d7a/users/ad00f9dad20a402d99de79444e838d1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.271738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59070ac2c0d4bea9a187a73fb4d7d7a, user_id=ad00f9dad20a402d99de79444e838d1f, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:25.274406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:25.286113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 941/1910] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:25 2022] PUT /identity/v3/projects/b59070ac2c0d4bea9a187a73fb4d7d7a/users/ad00f9dad20a402d99de79444e838d1f/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:25.286933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:25.311333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 970/1911] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:25.312835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.313148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.313429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.342643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] MFA Rules not processed for user `ad00f9dad20a402d99de79444e838d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:25.343861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:25.373235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890665f-9c93-44a2-9a75-4b81bcb37db4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:25.378688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:25.379351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.379740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.379897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.380632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:25.382712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:25.420078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 971/1912] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:25.420852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:25.422119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:25.478528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f03b26-6be2-4115-89a6-bdeaefe9ac62 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:25.488341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:25.488341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.488341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.488341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.557183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:25.558647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:25.569335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 972/1913] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:25.603387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:25.612733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978b164-be02-49e7-86a3-7f22f7cac4ce service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:25.616432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:25.617591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.617867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.618171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.628700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:25.630208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:25.645965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 973/1914] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:25.646884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:25.656877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528b793-cacb-4066-86f2-a296410291d2 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:25.661761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:25.662814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:25.663095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:25.663368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] PATH_INFO: `/v3/users/5d27f069c2b341a8b0c1812d7cfe33ca` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:25.664967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d27f069c2b341a8b0c1812d7cfe33ca)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:25.666855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.222634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 942/1915] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:25 2022] POST /identity/v3/projects => generated 383 bytes in 933 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:26.224372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:26.331204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074c473-915d-45cd-9fd7-3ef8e37a2d82 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:26.336755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b640f6-a620-4045-a7a8-ab3aa1cd1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:26.337522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b640f6-a620-4045-a7a8-ab3aa1cd1be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.337886 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b640f6-a620-4045-a7a8-ab3aa1cd1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.338244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b640f6-a620-4045-a7a8-ab3aa1cd1be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.339106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b640f6-a620-4045-a7a8-ab3aa1cd1be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:26.341282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b640f6-a620-4045-a7a8-ab3aa1cd1be9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.380529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d27f069c2b341a8b0c1812d7cfe33ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:26.381224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d27f069c2b341a8b0c1812d7cfe33ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:26.381849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d27f069c2b341a8b0c1812d7cfe33ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:26.398438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d27f069c2b341a8b0c1812d7cfe33ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:26.408231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d27f069c2b341a8b0c1812d7cfe33ca'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:26.550398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 943/1916] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:26 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:26.550764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 974/1917] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:25 2022] DELETE /identity/v3/users/5d27f069c2b341a8b0c1812d7cfe33ca => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:26.555031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.555160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:26.555240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.555240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.555431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:26.574642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:26.575907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:26.625732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b930-87ce-463a-a81c-22fe9301d5da admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:26.630772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:26.631438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.631719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.632028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.632812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:26.634428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.637221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 944/1918] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:26.648216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 975/1919] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:26.648395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:26.648605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:26.649186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:26.658789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79492580-e656-4d19-a4c6-09c868f2e4b0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:26.664423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:26.665304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.671197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.671197 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] PATH_INFO: `/v3/projects/3bc87feff5a042c79ee427b0b33922dd/users/d59b6969f50445ed96d2a466ef137d0b/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.684446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc87feff5a042c79ee427b0b33922dd, user_id=d59b6969f50445ed96d2a466ef137d0b, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:26.687228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.717516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d46b61-01bb-4622-9108-442e6c36358b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:26.721920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:26.722764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.723091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.723368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.733268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:26.734713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.745485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 945/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:26.797770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 976/1921] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:26 2022] PUT /identity/v3/projects/3bc87feff5a042c79ee427b0b33922dd/users/d59b6969f50445ed96d2a466ef137d0b/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:26.801802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:26.812902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7552-28da-4cdb-b4ac-b7758d2be44f service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:26.881306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58286443-6d5a-432f-bd97-ac81f48ca2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:26.882248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286443-6d5a-432f-bd97-ac81f48ca2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.882521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286443-6d5a-432f-bd97-ac81f48ca2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.882797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58286443-6d5a-432f-bd97-ac81f48ca2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.883803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58286443-6d5a-432f-bd97-ac81f48ca2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:26.885690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58286443-6d5a-432f-bd97-ac81f48ca2c2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.896130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 946/1922] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:26.900820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:26.914817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337c8af-ae52-4dc0-9917-13d0c2b5df50 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:26.920310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:26.921204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.921486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.921763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] PATH_INFO: `/v3/projects/3bc87feff5a042c79ee427b0b33922dd/users/d59b6969f50445ed96d2a466ef137d0b/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.924181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc87feff5a042c79ee427b0b33922dd, user_id=d59b6969f50445ed96d2a466ef137d0b, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:26.927649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:26.938728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 977/1923] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:26 2022] PUT /identity/v3/projects/3bc87feff5a042c79ee427b0b33922dd/users/d59b6969f50445ed96d2a466ef137d0b/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:26.950223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:26.950517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:26.950796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:26.983324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] MFA Rules not processed for user `d59b6969f50445ed96d2a466ef137d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:26.984591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.058397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 947/1924] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:27.295129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:27.297354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.303029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:27.304543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.310013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:27.396331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a327c7-2bb6-42a0-babb-7ae765a4bd76 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:27.401732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:27.402646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:27.402930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:27.403205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:27.406010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.442044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a15ca5-b2a1-4f34-9451-6edf31da8954 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:27.448165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:27.449068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:27.449416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:27.449833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] PATH_INFO: `/v3/projects/5b3278be78894d96895b418658bc2a0a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:27.451071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3278be78894d96895b418658bc2a0a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:27.453165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:27.484968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:27.486700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:27.498390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 948/1925] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:27.621468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3278be78894d96895b418658bc2a0a', 'request_id': 'req-ce85ff98-4976-4733-985f-05d2b3694c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:27.627221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3278be78894d96895b418658bc2a0a', 'request_id': 'req-ce85ff98-4976-4733-985f-05d2b3694c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:27.658358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:27.660523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.788865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3278be78894d96895b418658bc2a0a', 'request_id': 'req-ce85ff98-4976-4733-985f-05d2b3694c7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:27.804651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] The token cache is being invalidate because project 5b3278be78894d96895b418658bc2a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:27.809353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:27.809353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:27.809353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 978/1926] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:27 2022] DELETE /identity/v3/projects/5b3278be78894d96895b418658bc2a0a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:27.812915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:27.814486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.819146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058fd33-5bbf-441e-b209-adf7a05c302d service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:27.908202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad00f9dad20a402d99de79444e838d1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:27.912614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:27.912614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:27.912814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85ff98-4976-4733-985f-05d2b3694c7e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:27.912894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:27.912894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:27.912894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:27.913512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:27.915384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:27.916190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:27.916943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:27.917366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] PATH_INFO: `/v3/users/f14b12069e184d23946f392d6c8f9751` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:27.918991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b12069e184d23946f392d6c8f9751)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:27.921039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:27.931197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 949/1927] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:27.931197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:27.933378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:27.947543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe971cf-61e4-4827-996e-cd414f69303d tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:27.952929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:27.954142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:27.954431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:27.954706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] PATH_INFO: `/v3/users/bdf7f4ef34484f67b9a095755c333591` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:27.959694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf7f4ef34484f67b9a095755c333591)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:27.959694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:28.183272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b12069e184d23946f392d6c8f9751'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.184045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b12069e184d23946f392d6c8f9751'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.184155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf7f4ef34484f67b9a095755c333591'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.184706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf7f4ef34484f67b9a095755c333591'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.184904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b12069e184d23946f392d6c8f9751'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.185367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf7f4ef34484f67b9a095755c333591'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.198756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b12069e184d23946f392d6c8f9751'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.198974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf7f4ef34484f67b9a095755c333591'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.205566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b12069e184d23946f392d6c8f9751'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.206540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2b95f328-0d2b-48f1-86e8-7f0db01078e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf7f4ef34484f67b9a095755c333591'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.331480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 979/1928] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:27 2022] DELETE /identity/v3/users/f14b12069e184d23946f392d6c8f9751 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:28.332554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:28.334190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:28.408405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a353b-56b1-4e1d-a1f4-2882c36f8a8a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:28.413410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad00f9dad20a402d99de79444e838d1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:28.414076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:28.414391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:28.414669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:28.415361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:28.417566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:28.456057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 950/1929] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:27 2022] DELETE /identity/v3/users/bdf7f4ef34484f67b9a095755c333591 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:28.460958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:28.461400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:28.461778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:28.501496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:28.504137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:28.542733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 980/1930] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:28 2022] POST /identity/v3/projects => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:28.547534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:28.561069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:28.564252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:28.632792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 951/1931] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:28.640897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:28.642934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:28.668434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0db679-95e8-405b-a16c-93a0f409d6c7 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:28.685973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad00f9dad20a402d99de79444e838d1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:28.686666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:28.686954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:28.687242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:28.688030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:28.688335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:28.690294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:28.705020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 981/1932] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:28.728322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a5e6b-b981-4fc7-867e-f3f3e4180cc5 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:28.753960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:28.764886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318dac8-e796-446d-a84b-83883130530a tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:28.770627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad00f9dad20a402d99de79444e838d1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:28.771720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:28.772113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:28.772464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] PATH_INFO: `/v3/projects/abf887ccef3c4d87929caf49cbecd75d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:28.773838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abf887ccef3c4d87929caf49cbecd75d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:28.776192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:28.856576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:28.857426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:28.857788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:28.858140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:28.937277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf887ccef3c4d87929caf49cbecd75d', 'request_id': 'req-74a51bcb-757c-426f-8bfe-33e79ad53656'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.947882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf887ccef3c4d87929caf49cbecd75d', 'request_id': 'req-74a51bcb-757c-426f-8bfe-33e79ad53656'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:28.959633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:28.962173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:28.975802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 952/1933] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:28.977124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:28.988438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:28.995395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc038f55-48a9-4b95-804d-153c7dc4a1c7 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:29.046113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf887ccef3c4d87929caf49cbecd75d', 'request_id': 'req-74a51bcb-757c-426f-8bfe-33e79ad53656'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.081674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] The token cache is being invalidate because project abf887ccef3c4d87929caf49cbecd75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:29.081956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.082662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-74a51bcb-757c-426f-8bfe-33e79ad53656 tempest-VolumeQuotaClassesTest-1665547618 tempest-VolumeQuotaClassesTest-1665547618-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.088861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 982/1934] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:28 2022] DELETE /identity/v3/projects/abf887ccef3c4d87929caf49cbecd75d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:29.098289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:29.099439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.099821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.100479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] PATH_INFO: `/v3/projects/572796981a6740079d028d138a285d55` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.102553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572796981a6740079d028d138a285d55)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:29.104939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:29.280405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572796981a6740079d028d138a285d55', 'request_id': 'req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.286302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572796981a6740079d028d138a285d55', 'request_id': 'req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.292728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572796981a6740079d028d138a285d55', 'request_id': 'req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.412748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] The token cache is being invalidate because project 572796981a6740079d028d138a285d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:29.412983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.413640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.415749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 953/1935] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:28 2022] DELETE /identity/v3/projects/572796981a6740079d028d138a285d55 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:29.422643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1b8c7-b781-4667-82a5-7789e2ec4611 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.422963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1b8c7-b781-4667-82a5-7789e2ec4611 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.423244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1b8c7-b781-4667-82a5-7789e2ec4611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.444172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cff1b8c7-b781-4667-82a5-7789e2ec4611 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:29.445741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cff1b8c7-b781-4667-82a5-7789e2ec4611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:29.473249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:29.473249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:29.521124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 983/1936] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:29.529018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.529382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.529736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.552566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc28f1-4f67-4ce4-912b-23a3ef0a7221 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:29.558773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:29.559841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.560170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.560449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] PATH_INFO: `/v3/projects/ec4adf5dc87f4cecbedb237c9c23c8e0` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.561464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:29.561956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4adf5dc87f4cecbedb237c9c23c8e0)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:29.563712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:29.575283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:29.575545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:29.588724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 984/1937] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:29.595653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:29.606839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489bbc9-867f-40a2-b2ed-6d14b8d20fdd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:29.611656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:29.613007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.613292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.613724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.614461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:29.614772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:29.616390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:29.633250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 985/1938] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:29.634107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:29.645458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b2b81-3cb2-479b-b516-51aa29a17d03 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:29.650263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:29.650927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.651205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.651487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.652306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:29.654526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:29.738262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4adf5dc87f4cecbedb237c9c23c8e0', 'request_id': 'req-f7508404-504c-44a1-aa54-b1bd9f97d549'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.744494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4adf5dc87f4cecbedb237c9c23c8e0', 'request_id': 'req-f7508404-504c-44a1-aa54-b1bd9f97d549'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.767633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4adf5dc87f4cecbedb237c9c23c8e0', 'request_id': 'req-f7508404-504c-44a1-aa54-b1bd9f97d549'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.858739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 986/1939] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:29 2022] POST /identity/v3/projects => generated 407 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:29.863722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:29.887721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] The token cache is being invalidate because project ec4adf5dc87f4cecbedb237c9c23c8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:29.889016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.890996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f7508404-504c-44a1-aa54-b1bd9f97d549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:29.893134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 954/1940] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:29 2022] DELETE /identity/v3/projects/ec4adf5dc87f4cecbedb237c9c23c8e0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:29.896251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de19206-a4bd-49c1-b461-8ebd48f6d3f4 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.896757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de19206-a4bd-49c1-b461-8ebd48f6d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.897215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de19206-a4bd-49c1-b461-8ebd48f6d3f4 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.899473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 955/1941] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:50:29.901355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de19206-a4bd-49c1-b461-8ebd48f6d3f4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:29.904420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1de19206-a4bd-49c1-b461-8ebd48f6d3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:29.942975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a8de9-3e67-4b96-b458-382b463bc13c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:29.947554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8332-567c-4d2e-ab59-b24db040373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:29.948251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8332-567c-4d2e-ab59-b24db040373a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.948536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8332-567c-4d2e-ab59-b24db040373a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.948819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8332-567c-4d2e-ab59-b24db040373a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.949509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8332-567c-4d2e-ab59-b24db040373a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:29.951513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8332-567c-4d2e-ab59-b24db040373a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:29.981968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de19206-a4bd-49c1-b461-8ebd48f6d3f4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:29.986577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:29.987665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:29.988087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:29.988373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] PATH_INFO: `/v3/users/dbc6dc9f0a3549c1b173b45a118c1124` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:29.989607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc6dc9f0a3549c1b173b45a118c1124)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:29.991545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.067282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 987/1942] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:29 2022] POST /identity/v3/users => generated 304 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:30.067282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.067282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.067282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.097375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:30.098680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.185736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 988/1943] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:30.186694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:30.188030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.202022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3546e-16bb-4f7b-82ef-4c750707d250 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:30.208100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:30.209065 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.209443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.209821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] PATH_INFO: `/v3/users/771a4438846742d9b1e2fe57b265dd08` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.211722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771a4438846742d9b1e2fe57b265dd08)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:30.213777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.258473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc6dc9f0a3549c1b173b45a118c1124'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.259142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc6dc9f0a3549c1b173b45a118c1124'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.259755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc6dc9f0a3549c1b173b45a118c1124'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.275692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc6dc9f0a3549c1b173b45a118c1124'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.286406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc6dc9f0a3549c1b173b45a118c1124'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.368322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 956/1944] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:29 2022] DELETE /identity/v3/users/dbc6dc9f0a3549c1b173b45a118c1124 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:30.371288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:30.373132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.475776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771a4438846742d9b1e2fe57b265dd08'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.477893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771a4438846742d9b1e2fe57b265dd08'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.477893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771a4438846742d9b1e2fe57b265dd08'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.495745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771a4438846742d9b1e2fe57b265dd08'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.498446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f719655-c862-4d54-a95c-0c9aa52afee8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:30.505559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771a4438846742d9b1e2fe57b265dd08'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:30.514985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:30.515738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.516311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.518191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.518191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:30.519638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.531892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 957/1945] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:30.532680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:30.536282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.619355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 989/1946] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:30 2022] DELETE /identity/v3/users/771a4438846742d9b1e2fe57b265dd08 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:30.621175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:30.622724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.625324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:30.636135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96371ad-19f7-4413-abb0-f7596dccff14 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:30.746470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955da55-4eeb-4d64-9916-71d7796aaeb7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:30.753876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb048ea-db21-4e62-92ed-f2905ae1419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:30.754872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb048ea-db21-4e62-92ed-f2905ae1419d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.755657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb048ea-db21-4e62-92ed-f2905ae1419d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.756124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb048ea-db21-4e62-92ed-f2905ae1419d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.757056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb048ea-db21-4e62-92ed-f2905ae1419d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:30.759457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb048ea-db21-4e62-92ed-f2905ae1419d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.766450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:30.767344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.767668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.768850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.771524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.775739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 990/1947] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:30.775739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.775739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.775739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.789065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:30.790472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.795159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:30.796617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.802740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 958/1948] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:30.803610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:30.811493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 991/1949] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:30.814793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9eb8-134b-4427-b686-b544ee8e8ef0 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:30.820220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50d57e-2615-4947-8aed-b12530ea70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:30.820565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:30.821470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50d57e-2615-4947-8aed-b12530ea70da admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.821720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50d57e-2615-4947-8aed-b12530ea70da admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.821980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50d57e-2615-4947-8aed-b12530ea70da admin admin] PATH_INFO: `/v3/projects/db27cc739d7143edabff7e4994caca55/users/0375b7255d1a454f942d1ee2a948dd7e/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.822646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:30.851148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50d57e-2615-4947-8aed-b12530ea70da admin admin] RBAC: Authorizing `identity:create_grant(project_id=db27cc739d7143edabff7e4994caca55, user_id=0375b7255d1a454f942d1ee2a948dd7e, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:30.855757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50d57e-2615-4947-8aed-b12530ea70da admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.942358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538e8d2-a69a-43d3-8c18-9a0601e79277 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:30.947889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:30.949469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:30.949869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:30.950301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:30.962061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:30.963726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:30.979156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 992/1950] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:31.000721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.003295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:31.022966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933af772-7bed-4f6c-b664-a5868fe87058 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.028239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.029226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.029593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.029925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] PATH_INFO: `/v3/projects/1bc2f4f6fe10474987af3053616903e6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.031030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc2f4f6fe10474987af3053616903e6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.033005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.053709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 959/1951] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:30 2022] PUT /identity/v3/projects/db27cc739d7143edabff7e4994caca55/users/0375b7255d1a454f942d1ee2a948dd7e/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:31.065513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.065911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.066253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.102137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] MFA Rules not processed for user `0375b7255d1a454f942d1ee2a948dd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:31.103374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:31.183944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 960/1952] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:31.184125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc2f4f6fe10474987af3053616903e6', 'request_id': 'req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:31.185608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.187067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc2f4f6fe10474987af3053616903e6', 'request_id': 'req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:31.250962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2c43-f506-4f9b-a084-2dbae2ff7122 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.274367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc2f4f6fe10474987af3053616903e6', 'request_id': 'req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:31.295732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] The token cache is being invalidate because project 1bc2f4f6fe10474987af3053616903e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:31.296302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:31.297257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd1d43f-ce3a-417d-b1af-8b652bbbede6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:31.303598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 993/1953] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:30 2022] DELETE /identity/v3/projects/1bc2f4f6fe10474987af3053616903e6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:31.305138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860959c3-948e-4fa4-8868-a91b0d41f200 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.305874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860959c3-948e-4fa4-8868-a91b0d41f200 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.306157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860959c3-948e-4fa4-8868-a91b0d41f200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.333539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.334324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-860959c3-948e-4fa4-8868-a91b0d41f200 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:31.335445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.335580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-860959c3-948e-4fa4-8868-a91b0d41f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:31.335863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.336651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.338169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.340304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.348360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 994/1954] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:31.355170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.355559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.356022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.386021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:31.390299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:31.400393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 995/1955] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:31.404713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.418804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16d4e6-fdbf-4288-abbb-56984942d6df None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.426296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.427259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.427619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.428256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.428833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:31.429198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.431454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.448552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 996/1956] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:31.452970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.464418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de12ec5-bdb2-418c-a522-49d09f017688 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.471120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.472848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.473141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.473486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.476807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.476807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.508255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 961/1957] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/projects => generated 407 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:31.509019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.510702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:31.613225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 997/1958] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:31.615564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.619962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9400325-ab34-4b07-9585-944ff05ea47c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.707359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777e651-5a9d-4f12-a9dd-2da6113ab103 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.715001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.715001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.715001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.715001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.715442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.718165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.724882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.725638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.725920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.726191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.726890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.729079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.809640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 998/1959] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:31.810793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.812954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:31.831125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dd1a2-a345-4e6e-8822-09ff17e1c0d0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.838331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.838735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.839040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.839311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] PATH_INFO: `/v3/projects/113851356e914ed193ec2f163b998fdd` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.840632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113851356e914ed193ec2f163b998fdd)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.842486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.864245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 962/1960] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:31 2022] POST /identity/v3/users => generated 310 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:31.865442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.875568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a829d4-5d45-46bc-93f0-b4e4ccf4b0da admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.880826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.881362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.881654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.881959 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.882704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.886285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.895155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 963/1961] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:31.896057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.906151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2dbf8-11be-4a63-907d-318ffb843621 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.911672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.912414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.912706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.912984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.913707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.915302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.926953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 964/1962] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:31.927752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.937441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7ede7-294f-421e-95d9-70ca389fc3d9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.942087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.942718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.943007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.943281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.944020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.945585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.955268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 965/1963] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:31.956089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:31.965477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a7eab-2602-4850-958d-03aeaf543628 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:31.970017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:31.970884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:31.971819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:31.972172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] PATH_INFO: `/v3/projects/6ae4100b3242476e92beb09ffadf4f97/users/13659416abe5415382581ad01e04da96/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:31.991136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae4100b3242476e92beb09ffadf4f97, user_id=13659416abe5415382581ad01e04da96, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:31.994931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:31.995962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113851356e914ed193ec2f163b998fdd', 'request_id': 'req-fe107132-5779-4c80-9ff5-d2ba55b06685'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.002236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113851356e914ed193ec2f163b998fdd', 'request_id': 'req-fe107132-5779-4c80-9ff5-d2ba55b06685'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.074826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 966/1964] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:31 2022] PUT /identity/v3/projects/6ae4100b3242476e92beb09ffadf4f97/users/13659416abe5415382581ad01e04da96/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:32.075609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.113310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113851356e914ed193ec2f163b998fdd', 'request_id': 'req-fe107132-5779-4c80-9ff5-d2ba55b06685'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.131300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] The token cache is being invalidate because project 113851356e914ed193ec2f163b998fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:32.131802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.132539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.134278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 999/1965] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:31 2022] DELETE /identity/v3/projects/113851356e914ed193ec2f163b998fdd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:32.135116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.136519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:32.150704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6648c0-c28c-45c1-87e8-2437d970fa24 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:32.157784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:32.159470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.159715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.160033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] PATH_INFO: `/v3/projects/24ccf22830c247469d3f117315a6a58b/users/41de61b8d2664572a54f9aca2851b6ad/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.176251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ccf22830c247469d3f117315a6a58b, user_id=41de61b8d2664572a54f9aca2851b6ad, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:32.179002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:32.209055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe107132-5779-4c80-9ff5-d2ba55b06685 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:32.214485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:32.215362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.215643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.215960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.218366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:32.220254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:32.248987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1000/1966] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:32.248987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.251247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:32.271132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ac345-2d68-4a14-b559-2a9412e1b9b3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:32.279193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:32.280700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.281131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.281253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 967/1967] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:32 2022] PUT /identity/v3/projects/24ccf22830c247469d3f117315a6a58b/users/41de61b8d2664572a54f9aca2851b6ad/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:32.291448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] PATH_INFO: `/v3/users/ad00f9dad20a402d99de79444e838d1f` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.291595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.291692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad00f9dad20a402d99de79444e838d1f)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:32.291692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:32.406205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:32.413878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a9267-1032-4ef0-9a6d-8c97d3249b57 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:32.419356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902acfba-792d-461e-b86e-4cb993ae3c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:32.420384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902acfba-792d-461e-b86e-4cb993ae3c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.420672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902acfba-792d-461e-b86e-4cb993ae3c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.421071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902acfba-792d-461e-b86e-4cb993ae3c2e admin admin] PATH_INFO: `/v3/projects/6ae4100b3242476e92beb09ffadf4f97/users/13659416abe5415382581ad01e04da96/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.423259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902acfba-792d-461e-b86e-4cb993ae3c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae4100b3242476e92beb09ffadf4f97, user_id=13659416abe5415382581ad01e04da96, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:32.426439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902acfba-792d-461e-b86e-4cb993ae3c2e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:32.438908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 968/1968] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:32 2022] PUT /identity/v3/projects/6ae4100b3242476e92beb09ffadf4f97/users/13659416abe5415382581ad01e04da96/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:32.446078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1283b-2d02-499d-b2d5-1d2846cadccc None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.446379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1283b-2d02-499d-b2d5-1d2846cadccc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.446989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1283b-2d02-499d-b2d5-1d2846cadccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.477747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-89a1283b-2d02-499d-b2d5-1d2846cadccc None None] MFA Rules not processed for user `41de61b8d2664572a54f9aca2851b6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:32.480747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-89a1283b-2d02-499d-b2d5-1d2846cadccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:32.534383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad00f9dad20a402d99de79444e838d1f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.535102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad00f9dad20a402d99de79444e838d1f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.535718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad00f9dad20a402d99de79444e838d1f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.548126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad00f9dad20a402d99de79444e838d1f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.548638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 969/1969] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:32.550251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.550535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.550810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.559110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad00f9dad20a402d99de79444e838d1f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:32.579041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] MFA Rules not processed for user `13659416abe5415382581ad01e04da96`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:32.579503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:32.647144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1001/1970] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:32 2022] DELETE /identity/v3/users/ad00f9dad20a402d99de79444e838d1f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:32.648183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.649675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 970/1971] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:32.649782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:32.660744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.662297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:32.750518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43609-f6cb-4621-9aeb-9364f50a86aa None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:32.758999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b75f0-4793-483e-b393-fe8d5ad4dd0f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:32.766048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:32.766735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.767022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.768592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.769422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:32.773447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:32.835325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:32.835325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:32.835325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:32.835325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:32.900604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:32.902061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:32.913643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 971/1972] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:32 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:32.923428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1002/1973] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:32 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:32.923582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:32.935687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d5ea1-c5ba-4826-bf22-62bc865738fd service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.023404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.024134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.024424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.024740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.025526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.028136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.124628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 972/1974] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:32 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:33.128863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.140861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c88a38-6bd1-4605-b3a0-dcc2485ea7b7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.146439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.147168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.147454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.147760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.148522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.150439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.162157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1003/1975] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:33.167187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.178429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0520bdb-890f-4aed-8d87-06f0a7609b06 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.183589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.184613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.184948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.185277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] PATH_INFO: `/v3/projects/a552a03dd08443f28228a188af37e48a/users/a280d369f0ef4d91a2a96b15a10eca9b/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.201793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a552a03dd08443f28228a188af37e48a, user_id=a280d369f0ef4d91a2a96b15a10eca9b, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.204587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.218715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.220788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.235603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f3975-e376-483a-826b-f0365fc1fc16 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.241876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.242755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.243038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.243500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] PATH_INFO: `/v3/projects/b59070ac2c0d4bea9a187a73fb4d7d7a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.245147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59070ac2c0d4bea9a187a73fb4d7d7a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.247155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.341820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 973/1976] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:33 2022] PUT /identity/v3/projects/a552a03dd08443f28228a188af37e48a/users/a280d369f0ef4d91a2a96b15a10eca9b/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:33.345721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.392796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'request_id': 'req-a454a24a-1f9b-40f7-b849-0a1de4e3c849'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:33.400250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'request_id': 'req-a454a24a-1f9b-40f7-b849-0a1de4e3c849'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:33.426375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6eb6b1-5604-4d98-83dc-b05b7a062211 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.496778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.497483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.497779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.498072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.498945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.500604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.514083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59070ac2c0d4bea9a187a73fb4d7d7a', 'request_id': 'req-a454a24a-1f9b-40f7-b849-0a1de4e3c849'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:33.516088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 974/1977] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:33.523203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.523203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:33.523203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.532654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] The token cache is being invalidate because project b59070ac2c0d4bea9a187a73fb4d7d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:33.533019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:33.534341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:33.536623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1004/1978] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:33 2022] DELETE /identity/v3/projects/b59070ac2c0d4bea9a187a73fb4d7d7a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:33.537323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.538788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.587096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c3534-c3bc-461a-8c05-d6041c05fe18 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.591618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.591801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.592062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.592410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.594438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.625085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a24a-1f9b-40f7-b849-0a1de4e3c849 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.629778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.630445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.630734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.631018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.632900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.678427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.679909 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.690722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 975/1979] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:33.691815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.693613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.707169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ae20-f0e1-4716-b055-373f00a285fc service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.712477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77943035-2dff-42f2-a295-869f06c7c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.712627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.713396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77943035-2dff-42f2-a295-869f06c7c8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.713683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77943035-2dff-42f2-a295-869f06c7c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.713958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77943035-2dff-42f2-a295-869f06c7c8bd admin admin] PATH_INFO: `/v3/projects/a552a03dd08443f28228a188af37e48a/users/a280d369f0ef4d91a2a96b15a10eca9b/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.714391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f370f2-6cf8-4d56-8248-70aa336f6af7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.716500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77943035-2dff-42f2-a295-869f06c7c8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a552a03dd08443f28228a188af37e48a, user_id=a280d369f0ef4d91a2a96b15a10eca9b, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.719157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77943035-2dff-42f2-a295-869f06c7c8bd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.725290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1005/1980] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:33.726947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.727308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.727782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.753520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 976/1981] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:33 2022] PUT /identity/v3/projects/a552a03dd08443f28228a188af37e48a/users/a280d369f0ef4d91a2a96b15a10eca9b/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:33.753722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:33.755262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b6131-2ca5-4eec-afbc-07aaddd51c58 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.755555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b6131-2ca5-4eec-afbc-07aaddd51c58 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.755832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b6131-2ca5-4eec-afbc-07aaddd51c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.760388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.791016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-544b6131-2ca5-4eec-afbc-07aaddd51c58 None None] MFA Rules not processed for user `a280d369f0ef4d91a2a96b15a10eca9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:33.792738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-544b6131-2ca5-4eec-afbc-07aaddd51c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.872236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 977/1982] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:33.905082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1006/1983] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:33.915890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.916230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.916486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.937067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:33.938285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:33.947535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 978/1984] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:33.951160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.962103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b131b-f50b-4c33-92c4-216bbb360c50 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:33.967849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:33.968537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:33.968823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:33.969098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:33.969838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:33.970149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:33.972361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:33.984886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1007/1985] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:33.989279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:33.999338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458ef3b-0368-4db4-a3c5-55d1abfc6728 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.004200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.004863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.005149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.005427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.006161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.008131 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:34.153361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 979/1986] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:33 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:34.154528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:34.165108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25137f01-2be7-4813-aee2-840b44b082fb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.246440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.247118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.247394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.248088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.248394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.250533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:34.303383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:34.369921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1008/1987] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:34 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:34.374484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:34.385664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd3f66-f3e0-4866-8ad4-dc3dab246f3a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.390934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.391594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.391875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.392240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.393564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.395162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:34.405741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 980/1988] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:34.412301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:34.422215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c82866-fc2b-43e2-87e2-1b47bf791b4c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.427605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.428294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.428579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.428854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.429577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.431163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:34.442523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1009/1989] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:34.446926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:34.457449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1a631-a499-4790-a523-09c94f467f90 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.462153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e99f20-fe7f-4154-b9ce-aa45b9ad66c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.463034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99f20-fe7f-4154-b9ce-aa45b9ad66c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.463321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99f20-fe7f-4154-b9ce-aa45b9ad66c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.463601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e99f20-fe7f-4154-b9ce-aa45b9ad66c9 admin admin] PATH_INFO: `/v3/projects/2bb8dd409f084db496ff94152c035523/users/40d7a4dc99bc41e090fd68510aa28759/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.478098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99f20-fe7f-4154-b9ce-aa45b9ad66c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb8dd409f084db496ff94152c035523, user_id=40d7a4dc99bc41e090fd68510aa28759, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.480863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e99f20-fe7f-4154-b9ce-aa45b9ad66c9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:34.558173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:34.615940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b932d-7f9a-4908-b24f-2fafb73554a9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.623370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 981/1990] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:34 2022] PUT /identity/v3/projects/2bb8dd409f084db496ff94152c035523/users/40d7a4dc99bc41e090fd68510aa28759/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:34.634469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.634750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.635030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.666332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] MFA Rules not processed for user `40d7a4dc99bc41e090fd68510aa28759`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:34.667831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:34.672368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.673089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.673289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.673616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.754198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 982/1991] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:34.758866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:34.838065 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.846397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:34.852328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1010/1992] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:34.864516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049bc28-acd1-4377-a529-2057155a4d83 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:34.870846 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:34.871942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:34.872247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:34.872673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:34.873642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:34.875558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.018840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 983/1993] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:34 2022] POST /identity/v3/projects => generated 381 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:35.026136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.057358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44d927-7b5d-4068-a9c3-caf8a88c08b7 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.134198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.134871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.135177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.135449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.136166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.138083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.243235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1011/1994] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:35 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:35.244856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.260001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd3a7-792f-43f2-b189-7b9717abaa73 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.263456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.264271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.264631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.264979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.265713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.267336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.278727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 984/1995] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:35.282755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.293584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970952-1fdc-496f-bb74-5db6d29b0fa1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.301826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.304869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.304869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.304869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] PATH_INFO: `/v3/projects/35e145abaed24d07b2cead7b84e14771/users/1e7866efabad4f408f6651803430bddb/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.318482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e145abaed24d07b2cead7b84e14771, user_id=1e7866efabad4f408f6651803430bddb, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.321168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.324486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:35.438716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1012/1996] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:35 2022] PUT /identity/v3/projects/35e145abaed24d07b2cead7b84e14771/users/1e7866efabad4f408f6651803430bddb/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:35.442809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.453649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f867-56fd-45a5-b2ad-893dcc001784 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.564193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc89c6e-0751-4902-a384-880d4dfaad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.564193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc89c6e-0751-4902-a384-880d4dfaad23 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.564193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc89c6e-0751-4902-a384-880d4dfaad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.564193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc89c6e-0751-4902-a384-880d4dfaad23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.565239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc89c6e-0751-4902-a384-880d4dfaad23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.565239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc89c6e-0751-4902-a384-880d4dfaad23 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.575805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 985/1997] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:35.581925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.595025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5c1a6-9817-4237-93b1-f322c32db32a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.606989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.608106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.608493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.609021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] PATH_INFO: `/v3/projects/35e145abaed24d07b2cead7b84e14771/users/1e7866efabad4f408f6651803430bddb/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.611221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e145abaed24d07b2cead7b84e14771, user_id=1e7866efabad4f408f6651803430bddb, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.614247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.625355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1013/1998] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:35 2022] PUT /identity/v3/projects/35e145abaed24d07b2cead7b84e14771/users/1e7866efabad4f408f6651803430bddb/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:35.642024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.642609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.642609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.671090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] MFA Rules not processed for user `1e7866efabad4f408f6651803430bddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:35.672490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:35.736293 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.738617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:35.749859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 986/1999] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:35.787336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:35.787336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:35.836458 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96069b-98b5-4e5b-8a3d-aa917067769f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.841498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.842424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.842707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.842983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] PATH_INFO: `/v3/users/acf448f841d9464ba85cd6062904fde5` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.844443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf448f841d9464ba85cd6062904fde5)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.846401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.862552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2da02-a0a7-46ec-8ebc-acedd0ab5483 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:35.866419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efbd4a-37e5-4389-bfed-f18d1bb1d77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:35.872603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efbd4a-37e5-4389-bfed-f18d1bb1d77f service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:35.872603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efbd4a-37e5-4389-bfed-f18d1bb1d77f service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:35.872603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efbd4a-37e5-4389-bfed-f18d1bb1d77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:35.878666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efbd4a-37e5-4389-bfed-f18d1bb1d77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:35.880130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efbd4a-37e5-4389-bfed-f18d1bb1d77f service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:35.890144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 987/2000] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:36.170905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf448f841d9464ba85cd6062904fde5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:36.171872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf448f841d9464ba85cd6062904fde5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:36.172537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf448f841d9464ba85cd6062904fde5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:36.198402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf448f841d9464ba85cd6062904fde5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:36.209330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf448f841d9464ba85cd6062904fde5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:36.367118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1014/2001] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:35 2022] DELETE /identity/v3/users/acf448f841d9464ba85cd6062904fde5 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:36.372035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:36.372351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:36.372662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:36.391874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:36.393143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:36.451452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 988/2002] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:36.972005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:36.972005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:36.972005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fbf98-22c0-4709-b3d7-efacc30747d9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:36.974081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:36.974081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:36.974081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:36.974081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:36.976171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:36.976171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:36.976171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1015/2003] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:36.976817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:36.976817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:36.976817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec60d-92cb-4db5-83d7-3e669e55e50e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:36.977766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:36.977766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:36.977766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:36.977766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] PATH_INFO: `/v3/users/41de61b8d2664572a54f9aca2851b6ad` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:36.978265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] RBAC: Authorizing `identity:delete_user(user_id=41de61b8d2664572a54f9aca2851b6ad)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:36.978265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:36.978549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:36.978549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:37.068376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c960d-c884-4c70-a5a4-016a63d0db5a service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:37.070726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:37.071402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:37.071686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:37.071997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:37.074157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:37.107331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41de61b8d2664572a54f9aca2851b6ad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.108072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41de61b8d2664572a54f9aca2851b6ad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.108704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41de61b8d2664572a54f9aca2851b6ad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.122838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41de61b8d2664572a54f9aca2851b6ad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.131635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41de61b8d2664572a54f9aca2851b6ad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.171113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:37.171946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6302c-43d1-4714-8189-a099877bea1b service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:37.184483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1016/2004] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:37.231845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 989/2005] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:36 2022] DELETE /identity/v3/users/41de61b8d2664572a54f9aca2851b6ad => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:37.236154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:37.237263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:37.237646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:37.259590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:37.261141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:37.335226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1017/2006] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:37.358986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:37.362600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:37.389116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:37.390841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:37.410890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98105e-a89c-4b4d-8ae7-1f15e5dc389d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:37.432396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:37.436144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:37.436144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:37.436144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] PATH_INFO: `/v3/projects/9a4fc9f096e9451a84c690cb68ea51c6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:37.436144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4fc9f096e9451a84c690cb68ea51c6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:37.437480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:37.456333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b6aac-e40f-4f2f-99b7-6a399d7e511d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:37.461801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:37.462554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:37.462845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:37.463123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:37.474668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:37.476617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:37.489986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 990/2007] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:37.614263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4fc9f096e9451a84c690cb68ea51c6', 'request_id': 'req-bc08939e-ca91-43f8-a740-949cdc1ff7c5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.620072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4fc9f096e9451a84c690cb68ea51c6', 'request_id': 'req-bc08939e-ca91-43f8-a740-949cdc1ff7c5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.662917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:37.691833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4fc9f096e9451a84c690cb68ea51c6', 'request_id': 'req-bc08939e-ca91-43f8-a740-949cdc1ff7c5'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.706184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] The token cache is being invalidate because project 9a4fc9f096e9451a84c690cb68ea51c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:37.706687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.708381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:37.712373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1018/2008] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:37 2022] DELETE /identity/v3/projects/9a4fc9f096e9451a84c690cb68ea51c6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:37.713533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:37.726011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7064a4-f689-40c4-8a52-59f0f5a635c3 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:37.791383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:37.792323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:37.792607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:37.792881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] PATH_INFO: `/v3/users/7398b2629a4e4ff5ae39d95e972e40d3` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:37.794134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7398b2629a4e4ff5ae39d95e972e40d3)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:37.797082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:37.960440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:38.219872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7398b2629a4e4ff5ae39d95e972e40d3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:38.220554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7398b2629a4e4ff5ae39d95e972e40d3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:38.221266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7398b2629a4e4ff5ae39d95e972e40d3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:38.257174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7398b2629a4e4ff5ae39d95e972e40d3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:38.279182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7398b2629a4e4ff5ae39d95e972e40d3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:38.406613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 991/2009] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:37 2022] DELETE /identity/v3/users/7398b2629a4e4ff5ae39d95e972e40d3 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:38.902503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:38.904048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:38.927540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08939e-ca91-43f8-a740-949cdc1ff7c5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:39.064266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:39.065903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:39.066187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:39.066454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] PATH_INFO: `/v3/projects/24ccf22830c247469d3f117315a6a58b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:39.068675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ccf22830c247469d3f117315a6a58b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:39.070953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:39.250539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ccf22830c247469d3f117315a6a58b', 'request_id': 'req-332e7ac7-47a2-4687-9b45-2fc2eca607bd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.258242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ccf22830c247469d3f117315a6a58b', 'request_id': 'req-332e7ac7-47a2-4687-9b45-2fc2eca607bd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.359885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ccf22830c247469d3f117315a6a58b', 'request_id': 'req-332e7ac7-47a2-4687-9b45-2fc2eca607bd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.378714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] The token cache is being invalidate because project 24ccf22830c247469d3f117315a6a58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:39.380188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.381341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.384686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1019/2010] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:38 2022] DELETE /identity/v3/projects/24ccf22830c247469d3f117315a6a58b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:39.388771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:39.390295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:39.444011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd27990-d405-432e-b520-d04b4c646d80 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:39.484393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:39.484393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:39.501942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:39.503214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:39.503350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:39.503793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] PATH_INFO: `/v3/users/a280d369f0ef4d91a2a96b15a10eca9b` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:39.505250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a280d369f0ef4d91a2a96b15a10eca9b)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:39.507654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:39.609333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e7ac7-47a2-4687-9b45-2fc2eca607bd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:39.619113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:39.620167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:39.620451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:39.620725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] PATH_INFO: `/v3/projects/8365794f74244e04a20a791df588b437` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:39.622157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8365794f74244e04a20a791df588b437)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:39.624617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:39.789050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a280d369f0ef4d91a2a96b15a10eca9b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.792108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8365794f74244e04a20a791df588b437', 'request_id': 'req-6d96615a-6a25-47ab-b204-94bee6c86a3c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.792275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a280d369f0ef4d91a2a96b15a10eca9b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.792692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a280d369f0ef4d91a2a96b15a10eca9b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.803741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8365794f74244e04a20a791df588b437', 'request_id': 'req-6d96615a-6a25-47ab-b204-94bee6c86a3c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.830800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:39.834035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a280d369f0ef4d91a2a96b15a10eca9b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.844828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-9fa0849e-2889-477c-9186-b3a0d2f9933b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a280d369f0ef4d91a2a96b15a10eca9b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.891147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8365794f74244e04a20a791df588b437', 'request_id': 'req-6d96615a-6a25-47ab-b204-94bee6c86a3c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.910746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] The token cache is being invalidate because project 8365794f74244e04a20a791df588b437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:39.911423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.911833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6d96615a-6a25-47ab-b204-94bee6c86a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:39.914862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1020/2011] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:39 2022] DELETE /identity/v3/projects/8365794f74244e04a20a791df588b437 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:39.920092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:39.920708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:39.921151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:39.955860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:39.961926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:40.012816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 992/2012] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:39 2022] DELETE /identity/v3/users/a280d369f0ef4d91a2a96b15a10eca9b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:40.073879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1021/2013] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:40.084043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:40.084339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:40.084626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:40.122623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:40.124733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:40.277440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 993/2014] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:40.278590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:40.287056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51858e-0770-425c-9c2b-1967368735e1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:40.290260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:40.291670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:40.291670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:40.291670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:40.292654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:40.293037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:40.295188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:40.309529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1022/2015] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:40.313793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:40.325151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae165e7-32f5-4b83-b0be-ddd02d77d23b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:40.331659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:40.332925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:40.333217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:40.333499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:40.334504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:40.336310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:40.518285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:40.558633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 994/2016] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:40 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:40.562789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:40.584540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899612e-fcea-43c1-a09f-ddb16b286bc8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:40.680224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:40.681240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:40.681689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:40.682129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:40.701872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:40.704117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:40.713196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:40.714523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:40.736074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c67a6-f104-4e5d-92c8-b9488f21df95 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:40.742471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:40.749628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:40.750900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:40.751186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:40.751484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] PATH_INFO: `/v3/projects/a552a03dd08443f28228a188af37e48a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:40.754183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a552a03dd08443f28228a188af37e48a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:40.759193 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:40.879537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1023/2017] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:40 2022] POST /identity/v3/users => generated 285 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:40.891498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:40.898657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5ba79-2683-4ac0-a56b-d8634c76c758 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:40.909500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:40.910449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:40.910855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:40.911451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:40.912198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:40.913995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:40.929792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1024/2018] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:40.933482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:40.946408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966090-cf58-4746-9183-2a45db3b76fb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:40.952287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a552a03dd08443f28228a188af37e48a', 'request_id': 'req-2e07a904-44e1-4781-a472-5a304b76ffe0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:40.958496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a552a03dd08443f28228a188af37e48a', 'request_id': 'req-2e07a904-44e1-4781-a472-5a304b76ffe0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:40.965263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a552a03dd08443f28228a188af37e48a', 'request_id': 'req-2e07a904-44e1-4781-a472-5a304b76ffe0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.013942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.014697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.015034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.015368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.016303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.017998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.028102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1025/2019] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:41.032319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.042846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb9056-14ad-4933-b87e-65fe669016fb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.048340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e192dd0-c6d7-4599-8f15-dbd33bb6b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.049830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e192dd0-c6d7-4599-8f15-dbd33bb6b63b admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.050566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e192dd0-c6d7-4599-8f15-dbd33bb6b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.050566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e192dd0-c6d7-4599-8f15-dbd33bb6b63b admin admin] PATH_INFO: `/v3/projects/debae12c6276456f83c8f2f95a85528f/users/ad194da67b5c48ab8af3d47087943370/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.067888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e192dd0-c6d7-4599-8f15-dbd33bb6b63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=debae12c6276456f83c8f2f95a85528f, user_id=ad194da67b5c48ab8af3d47087943370, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.070598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e192dd0-c6d7-4599-8f15-dbd33bb6b63b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.093526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] The token cache is being invalidate because project a552a03dd08443f28228a188af37e48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:41.098557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.098557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2e07a904-44e1-4781-a472-5a304b76ffe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.098557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 995/2020] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:40 2022] DELETE /identity/v3/projects/a552a03dd08443f28228a188af37e48a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:41.106988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901e7f-eed1-46e4-a6ec-214a70350604 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.107343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901e7f-eed1-46e4-a6ec-214a70350604 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.107726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80901e7f-eed1-46e4-a6ec-214a70350604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.134071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-80901e7f-eed1-46e4-a6ec-214a70350604 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:41.134554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-80901e7f-eed1-46e4-a6ec-214a70350604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.143446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 996/2021] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:41.150973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.151743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.151743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.184179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1026/2022] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:41 2022] PUT /identity/v3/projects/debae12c6276456f83c8f2f95a85528f/users/ad194da67b5c48ab8af3d47087943370/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:41.192347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.192823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.193112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.199585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:41.201287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.255040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] MFA Rules not processed for user `ad194da67b5c48ab8af3d47087943370`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:41.255040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.296121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 997/2023] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:41.300719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.308258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf334-fd80-4404-942c-ff7070cf679b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.317297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.318496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.318834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.319116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.319933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:41.320278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.322192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.340094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 998/2024] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:41.341062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.343305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.359144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a433e-c20c-466c-bd37-b4b215414c73 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.367320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.368271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.368549 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.369907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] PATH_INFO: `/v3/users/40d7a4dc99bc41e090fd68510aa28759` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.370092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d7a4dc99bc41e090fd68510aa28759)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.372099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.398699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1027/2025] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:41.399997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.414634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f69a95-4c74-4596-bb7d-cc7bb8663415 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.421155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.421867 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.422152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.427037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.427037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.427037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.556940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1028/2026] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:41 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:41.556940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.561082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.621484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d7a4dc99bc41e090fd68510aa28759'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.622771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d7a4dc99bc41e090fd68510aa28759'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.623506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d7a4dc99bc41e090fd68510aa28759'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.641452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d7a4dc99bc41e090fd68510aa28759'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.653160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d7a4dc99bc41e090fd68510aa28759'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:41.656001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dabf0-02d1-4523-af82-f559adbbe51d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.667835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.669013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.675883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.675883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.675883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.678471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.730659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 999/2027] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:41 2022] DELETE /identity/v3/users/40d7a4dc99bc41e090fd68510aa28759 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:41.731727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.733620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.809562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dce4ed-a19b-461d-8f62-54cf464f0dc0 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.816731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22819b-65fd-4939-a00f-0ccb5fdb714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.817428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22819b-65fd-4939-a00f-0ccb5fdb714c admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.818253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22819b-65fd-4939-a00f-0ccb5fdb714c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.818549 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22819b-65fd-4939-a00f-0ccb5fdb714c admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.819898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22819b-65fd-4939-a00f-0ccb5fdb714c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.821908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22819b-65fd-4939-a00f-0ccb5fdb714c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:41.876390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1029/2028] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:41 2022] POST /identity/v3/projects => generated 367 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:41.878221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:41.880496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:41.946910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080b4ff-b625-4877-ad66-51dd768c60b4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:41.955844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:41.955844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:41.955844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:41.955844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] PATH_INFO: `/v3/users/4d5bdcee010148119ed457a154b53bdc` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:41.956231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5bdcee010148119ed457a154b53bdc)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:41.957509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.015892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1000/2029] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:41 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:42.017283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.018291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.018291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.041148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:42.042372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.055266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1001/2030] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:42.056597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.058133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.071873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67045471-31fa-4a94-9481-1d8548a8dbdc None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.077013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.077731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.077992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.078259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.078963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.081197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.177650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1002/2031] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:42 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:42.178513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.186416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5bdcee010148119ed457a154b53bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:42.187239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5bdcee010148119ed457a154b53bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:42.187965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5bdcee010148119ed457a154b53bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:42.191842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983e526-0f8e-4903-a6c2-0a60e14495cf admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.196825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.197511 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.197790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.198061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.198793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.200486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.206075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5bdcee010148119ed457a154b53bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:42.211088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1003/2032] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:42.212050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.213770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.213974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5bdcee010148119ed457a154b53bdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:42.273951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41524516-1ee3-43b0-b3fc-33a0eaf44187 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.278102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.278899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.279256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.279604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.281939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.290355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1030/2033] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:41 2022] DELETE /identity/v3/users/4d5bdcee010148119ed457a154b53bdc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:42.293416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.295704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.311595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.313614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.346781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1004/2034] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:42.347810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.349301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.398325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2a8c-15da-4e91-bb54-239ffc573598 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.405815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c6da0-f64d-44ff-86b3-3f258f0597ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.406512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c6da0-f64d-44ff-86b3-3f258f0597ac admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.406802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c6da0-f64d-44ff-86b3-3f258f0597ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.407091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c6da0-f64d-44ff-86b3-3f258f0597ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.408586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c6da0-f64d-44ff-86b3-3f258f0597ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.410482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c6da0-f64d-44ff-86b3-3f258f0597ac admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.410876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750d627-bc54-42b9-9f0f-71bb99efc677 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.418026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.419628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.420112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.420614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.421464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.422847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1005/2035] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:42.425291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.425588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.425870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.428082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.443556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1031/2036] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:42.445347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.459657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eed6c-d32c-426b-985e-e253a5d883ff admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.467554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:42.469847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.477384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.481107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.481317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.481619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] PATH_INFO: `/v3/projects/3e6c32cd0cba4b4596d24fde4208dac2/users/435715b0864a43bb969438fed060336a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.488447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1006/2037] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:42.491071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.515264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfc1fd-622d-4c56-b970-661183b559d4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.522394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6c32cd0cba4b4596d24fde4208dac2, user_id=435715b0864a43bb969438fed060336a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.523367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.524713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.525194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.525437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.526246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] PATH_INFO: `/v3/projects/495d43b924f940f6a7c8b7763c87e1ee/users/eb5c9d2a8f584913809dd409171d94e1/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.550225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=495d43b924f940f6a7c8b7763c87e1ee, user_id=eb5c9d2a8f584913809dd409171d94e1, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.553368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.654033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1032/2038] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:42 2022] PUT /identity/v3/projects/3e6c32cd0cba4b4596d24fde4208dac2/users/435715b0864a43bb969438fed060336a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:42.654960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.656192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1007/2039] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:42 2022] PUT /identity/v3/projects/495d43b924f940f6a7c8b7763c87e1ee/users/eb5c9d2a8f584913809dd409171d94e1/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:42.658666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.661792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.786249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12dd3cb-fc49-460d-aa93-7e6a8029f842 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.791387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b735d15-0743-441e-908f-f2cd1d654817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.792075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735d15-0743-441e-908f-f2cd1d654817 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.792357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735d15-0743-441e-908f-f2cd1d654817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.792728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b735d15-0743-441e-908f-f2cd1d654817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.804669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511ca72-eb0a-47dd-a8ee-379d737a2c3b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.881321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b735d15-0743-441e-908f-f2cd1d654817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.882125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.882828 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b735d15-0743-441e-908f-f2cd1d654817 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.883494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.883907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.884376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.885241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.887176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.895440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1033/2040] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:42.896886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.897171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.897447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.904638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1008/2041] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:42.905748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:42.931114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c66f4-2772-485d-81c9-cdecbf55f553 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:42.936451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b39b2d-0b80-4ee9-8b5f-5d3b6f7a8349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:42.937377 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39b2d-0b80-4ee9-8b5f-5d3b6f7a8349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.937691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39b2d-0b80-4ee9-8b5f-5d3b6f7a8349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.937943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b39b2d-0b80-4ee9-8b5f-5d3b6f7a8349 admin admin] PATH_INFO: `/v3/projects/495d43b924f940f6a7c8b7763c87e1ee/users/eb5c9d2a8f584913809dd409171d94e1/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.939738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] MFA Rules not processed for user `435715b0864a43bb969438fed060336a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:42.940079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b39b2d-0b80-4ee9-8b5f-5d3b6f7a8349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=495d43b924f940f6a7c8b7763c87e1ee, user_id=eb5c9d2a8f584913809dd409171d94e1, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:42.941713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:42.942706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b39b2d-0b80-4ee9-8b5f-5d3b6f7a8349 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:42.953557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1009/2042] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:42 2022] PUT /identity/v3/projects/495d43b924f940f6a7c8b7763c87e1ee/users/eb5c9d2a8f584913809dd409171d94e1/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:42.965772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:42.966056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:42.966352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:42.998445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] MFA Rules not processed for user `eb5c9d2a8f584913809dd409171d94e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:42.999746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.011467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1034/2043] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:43.022658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:43.024089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.099221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67987602-b008-4c59-b8bf-a8c611c44775 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:43.125364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:43.125980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1010/2044] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:43.127727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:43.129260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.170946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:43.172100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:43.172100 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:43.172276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:43.240258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbafdc5-8b0a-4690-8710-b408168fa161 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:43.249485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:43.252553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:43.252553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:43.252553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] PATH_INFO: `/v3/projects/2bb8dd409f084db496ff94152c035523` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:43.256175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb8dd409f084db496ff94152c035523)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:43.259175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:43.278641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:43.295023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:43.295023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1035/2045] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:43.295023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:43.296371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.315631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45974295-51d3-4da3-8bba-4c4a63c53c8a service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:43.320891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:43.320891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:43.321164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:43.321263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:43.334154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:43.335700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:43.346999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1036/2046] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:43.347947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:43.349323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.367728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84da1-9e8b-478d-b35f-502bbacc6763 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:43.377684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:43.385010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:43.386110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:43.386392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:43.389099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] PATH_INFO: `/v3/users/0375b7255d1a454f942d1ee2a948dd7e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:43.389962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0375b7255d1a454f942d1ee2a948dd7e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:43.394730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:43.445141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb8dd409f084db496ff94152c035523', 'request_id': 'req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.456257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb8dd409f084db496ff94152c035523', 'request_id': 'req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.465092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb8dd409f084db496ff94152c035523', 'request_id': 'req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.592649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] The token cache is being invalidate because project 2bb8dd409f084db496ff94152c035523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:43.593172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.594039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.596805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1011/2047] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:43 2022] DELETE /identity/v3/projects/2bb8dd409f084db496ff94152c035523 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:43.600825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:43.602217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.668289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bbfe7-1147-491d-af70-e1db43d8ccc6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:43.673726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:43.674646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:43.674931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:43.675208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] PATH_INFO: `/v3/users/1e7866efabad4f408f6651803430bddb` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:43.676609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7866efabad4f408f6651803430bddb)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:43.678552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:43.808352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0375b7255d1a454f942d1ee2a948dd7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.809584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0375b7255d1a454f942d1ee2a948dd7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.810185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0375b7255d1a454f942d1ee2a948dd7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.823948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0375b7255d1a454f942d1ee2a948dd7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.830891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0375b7255d1a454f942d1ee2a948dd7e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.972568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1037/2048] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:43 2022] DELETE /identity/v3/users/0375b7255d1a454f942d1ee2a948dd7e => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:43.972568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:43.981957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7866efabad4f408f6651803430bddb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.982756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7866efabad4f408f6651803430bddb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.982956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:43.983577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7866efabad4f408f6651803430bddb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:43.997912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7866efabad4f408f6651803430bddb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.007002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-369c2d12-c08a-4632-8cd0-fee6dcaa8b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7866efabad4f408f6651803430bddb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.061880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe646ff9-3e87-4f4e-a5bf-d11a4d913816 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:44.066773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:44.067624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:44.067904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:44.068221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] PATH_INFO: `/v3/projects/81027d6d00f343eabc718dd33a0eb32a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:44.069373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81027d6d00f343eabc718dd33a0eb32a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:44.071422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:44.155326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1012/2049] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:43 2022] DELETE /identity/v3/users/1e7866efabad4f408f6651803430bddb => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:44.156963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:44.157109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:44.157334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:44.178929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:44.180434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:44.236846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81027d6d00f343eabc718dd33a0eb32a', 'request_id': 'req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.245033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81027d6d00f343eabc718dd33a0eb32a', 'request_id': 'req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.252093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1013/2050] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:44.255598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:44.257154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:44.329498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987b821-55c5-4068-ae1d-e5ed3777c313 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:44.338127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81027d6d00f343eabc718dd33a0eb32a', 'request_id': 'req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.352540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] The token cache is being invalidate because project 81027d6d00f343eabc718dd33a0eb32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:44.352968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.353720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.355396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1038/2051] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:43 2022] DELETE /identity/v3/projects/81027d6d00f343eabc718dd33a0eb32a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:44.359187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:44.360588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:44.382259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:44.382921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:44.383330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:44.383615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:44.386130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:44.514152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a49294-82d2-4ab6-b1f9-32b00ba0abf1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:44.530130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:44.531598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:44.536240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:44.545958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1014/2052] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:44.547649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:44.547986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:44.555793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] PATH_INFO: `/v3/users/d59b6969f50445ed96d2a466ef137d0b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:44.555793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59b6969f50445ed96d2a466ef137d0b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:44.555793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:44.791109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:44.791109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:44.804691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589884cd-b6a4-44bd-a79e-e4d329a64119 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:44.810514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:44.812380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:44.812599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:44.813056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] PATH_INFO: `/v3/projects/35e145abaed24d07b2cead7b84e14771` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:44.814708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e145abaed24d07b2cead7b84e14771)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:44.819896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:44.830138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59b6969f50445ed96d2a466ef137d0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.831212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59b6969f50445ed96d2a466ef137d0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.832232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59b6969f50445ed96d2a466ef137d0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.848707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59b6969f50445ed96d2a466ef137d0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.855677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59b6969f50445ed96d2a466ef137d0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.978976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1039/2053] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:44 2022] DELETE /identity/v3/users/d59b6969f50445ed96d2a466ef137d0b => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:44.990194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e145abaed24d07b2cead7b84e14771', 'request_id': 'req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:44.995987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e145abaed24d07b2cead7b84e14771', 'request_id': 'req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.004822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e145abaed24d07b2cead7b84e14771', 'request_id': 'req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.098571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:45.100320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:45.107169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] The token cache is being invalidate because project 35e145abaed24d07b2cead7b84e14771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:45.107460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.108137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4fde8f40-f2d5-492f-ba21-81b48dd83ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.113663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1015/2054] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:44 2022] DELETE /identity/v3/projects/35e145abaed24d07b2cead7b84e14771 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:45.134558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaff81a-b2fc-46f6-8de6-6f96f0bbabc7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.134558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaff81a-b2fc-46f6-8de6-6f96f0bbabc7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.134558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaff81a-b2fc-46f6-8de6-6f96f0bbabc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.168437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-beaff81a-b2fc-46f6-8de6-6f96f0bbabc7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:45.168437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-beaff81a-b2fc-46f6-8de6-6f96f0bbabc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:45.180667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1016/2055] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:45.180955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb179e-982d-459b-aaad-dd92834416f7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:45.192474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:45.203315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f356f0-9728-405e-8f90-743c94680524 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.203315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f356f0-9728-405e-8f90-743c94680524 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.203315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f356f0-9728-405e-8f90-743c94680524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.203905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.203905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.203905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] PATH_INFO: `/v3/projects/db27cc739d7143edabff7e4994caca55` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.203905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=db27cc739d7143edabff7e4994caca55)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:45.203905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:45.216071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-43f356f0-9728-405e-8f90-743c94680524 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:45.217302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-43f356f0-9728-405e-8f90-743c94680524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:45.226652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1017/2056] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:45.232009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f356f0-9728-405e-8f90-743c94680524 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:45.239837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f356f0-9728-405e-8f90-743c94680524 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:45.244771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:45.245408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.245721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.245999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.246720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:45.247043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:45.248683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:45.263953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1018/2057] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:45.265187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:45.276385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84475d2c-6d36-4068-9557-3e80ab41188a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:45.281618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:45.282370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.289081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.289081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.289081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:45.289081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:45.362788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db27cc739d7143edabff7e4994caca55', 'request_id': 'req-d3547f20-75f6-4905-893f-522a437e90ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.369112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db27cc739d7143edabff7e4994caca55', 'request_id': 'req-d3547f20-75f6-4905-893f-522a437e90ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.401844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1019/2058] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:45 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:45.403609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:45.411211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:45.473806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a567ea-f354-4c19-bd54-3c76e1c37260 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:45.478751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db27cc739d7143edabff7e4994caca55', 'request_id': 'req-d3547f20-75f6-4905-893f-522a437e90ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.479005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:45.479746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.480068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.480351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.481109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:45.488716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:45.497360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] The token cache is being invalidate because project db27cc739d7143edabff7e4994caca55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:45.497927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.498698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.500587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1040/2059] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:45 2022] DELETE /identity/v3/projects/db27cc739d7143edabff7e4994caca55 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:45.508662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:45.510511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:45.585929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547f20-75f6-4905-893f-522a437e90ec admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:45.588926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:45.589849 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.590133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.590417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] PATH_INFO: `/v3/users/13659416abe5415382581ad01e04da96` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.591614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13659416abe5415382581ad01e04da96)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:45.593622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:45.642100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:45.655661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1020/2060] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:45 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:45.658169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:45.660303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:45.676577 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1929-6766-4da8-9589-5b3b4fb007c9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:45.681766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:45.682674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:45.682961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:45.683244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] PATH_INFO: `/v3/projects/3bc87feff5a042c79ee427b0b33922dd` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:45.684537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc87feff5a042c79ee427b0b33922dd)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:45.686528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:45.838666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13659416abe5415382581ad01e04da96'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.839430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13659416abe5415382581ad01e04da96'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.841618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13659416abe5415382581ad01e04da96'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.870651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13659416abe5415382581ad01e04da96'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.871409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc87feff5a042c79ee427b0b33922dd', 'request_id': 'req-05907db7-17f4-4b19-8d7e-3aa45a1925eb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.880684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc87feff5a042c79ee427b0b33922dd', 'request_id': 'req-05907db7-17f4-4b19-8d7e-3aa45a1925eb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.884951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13659416abe5415382581ad01e04da96'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:45.895822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc87feff5a042c79ee427b0b33922dd', 'request_id': 'req-05907db7-17f4-4b19-8d7e-3aa45a1925eb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:46.037988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1041/2061] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:45 2022] DELETE /identity/v3/users/13659416abe5415382581ad01e04da96 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:46.039429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.041023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.120347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] The token cache is being invalidate because project 3bc87feff5a042c79ee427b0b33922dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:46.120844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:46.121948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-05907db7-17f4-4b19-8d7e-3aa45a1925eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:46.125571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1021/2062] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:45 2022] DELETE /identity/v3/projects/3bc87feff5a042c79ee427b0b33922dd => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:46.132814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47815f9e-0c6d-483d-a7d6-ad21c5a5424f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.133404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47815f9e-0c6d-483d-a7d6-ad21c5a5424f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.133894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47815f9e-0c6d-483d-a7d6-ad21c5a5424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.140631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3210-9f4f-48b4-8354-01437462d09e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.148093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.149214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.153481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.153481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.153481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.153481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.175304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-47815f9e-0c6d-483d-a7d6-ad21c5a5424f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:46.178663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1042/2063] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:46.178780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-47815f9e-0c6d-483d-a7d6-ad21c5a5424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.179841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.184557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.192496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1022/2064] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:46.200355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9155ad-9472-487c-bf3a-c19714ab5e5e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.201675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.201819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.202172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.206195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.207034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.207323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.207604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.208452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.213092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.221002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1043/2065] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:46.226194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:46.227436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.227988 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.236375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1023/2066] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:46.239217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859a06c-8d52-476f-91a0-93daeaf5ae11 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.244843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.246927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397026-ce4a-4d98-9abf-2195a33d85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.247840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397026-ce4a-4d98-9abf-2195a33d85c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.248156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397026-ce4a-4d98-9abf-2195a33d85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.248446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397026-ce4a-4d98-9abf-2195a33d85c7 admin admin] PATH_INFO: `/v3/projects/9ee6c26076e647158211de0078d92d7e/users/c1bbb5456222458090e00ed1fbaaff10/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.256985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83ddd7-cbff-440e-b508-bc8fea9f6722 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.261751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.262448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.262729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.263010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.263756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:46.264179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.265827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.269963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397026-ce4a-4d98-9abf-2195a33d85c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ee6c26076e647158211de0078d92d7e, user_id=c1bbb5456222458090e00ed1fbaaff10, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.274080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397026-ce4a-4d98-9abf-2195a33d85c7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.286919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1024/2067] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:50:46.288582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.313667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9049ba-b04b-4151-8a43-e119704560b6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.320470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.321192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.321446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.321723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.323399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.325892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.425952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1044/2068] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:46 2022] PUT /identity/v3/projects/9ee6c26076e647158211de0078d92d7e/users/c1bbb5456222458090e00ed1fbaaff10/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:46.437208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.437495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.437959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.471871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1025/2069] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:46 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:46.472614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] MFA Rules not processed for user `c1bbb5456222458090e00ed1fbaaff10`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:46.473176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.474380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.566232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1045/2070] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:46.583956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272fb5f-d398-4394-abc9-b4a0c9e778eb admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.588700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.589373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.589662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.589941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.590674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.592681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.728108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.729059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1026/2071] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:46 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:46.729703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.731249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.735301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:46.758098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a9477-55a4-4de8-8203-a5adbdd884ff None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.769096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.769456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.769653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.771177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] PATH_INFO: `/v3/projects/6ae4100b3242476e92beb09ffadf4f97` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.772855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae4100b3242476e92beb09ffadf4f97)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.780258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.849530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ed28d-5b05-4ddf-a62c-b929d0e6bc5c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.858097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.862733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.863229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.864498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.877791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.880451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.901941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1027/2072] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:46.904663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.920072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66a9af-ee32-44eb-a7a5-70344b006fef service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.925202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.925877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.926164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.926442 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.927171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.928869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:46.946739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1028/2073] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:46.950573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:46.963516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9798a-5971-40d3-8d77-a06ed91eecaf admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:46.974633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:46.975581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:46.975855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:46.976238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] PATH_INFO: `/v3/users/c1bbb5456222458090e00ed1fbaaff10` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:46.977506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bbb5456222458090e00ed1fbaaff10)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:46.979544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.060327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae4100b3242476e92beb09ffadf4f97', 'request_id': 'req-cb198506-0536-4d8a-a43a-5f1905538c79'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.066362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae4100b3242476e92beb09ffadf4f97', 'request_id': 'req-cb198506-0536-4d8a-a43a-5f1905538c79'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.102513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:47.142048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae4100b3242476e92beb09ffadf4f97', 'request_id': 'req-cb198506-0536-4d8a-a43a-5f1905538c79'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.154783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] The token cache is being invalidate because project 6ae4100b3242476e92beb09ffadf4f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:47.155071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.155841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.157598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1046/2074] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:46 2022] DELETE /identity/v3/projects/6ae4100b3242476e92beb09ffadf4f97 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:47.160747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.162212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.173827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bbb5456222458090e00ed1fbaaff10'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.174682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bbb5456222458090e00ed1fbaaff10'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.175397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bbb5456222458090e00ed1fbaaff10'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.187433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bbb5456222458090e00ed1fbaaff10'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.194800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4687a4ab-4c18-4a3c-964f-3ea6ccb24e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bbb5456222458090e00ed1fbaaff10'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:47.227294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb198506-0536-4d8a-a43a-5f1905538c79 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.231961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49456423-fb5a-495b-8490-0275189a198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.232623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456423-fb5a-495b-8490-0275189a198a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.232906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456423-fb5a-495b-8490-0275189a198a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.233185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49456423-fb5a-495b-8490-0275189a198a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.233917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456423-fb5a-495b-8490-0275189a198a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.235522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49456423-fb5a-495b-8490-0275189a198a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.252911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1047/2075] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:47.252911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.252911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.252911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.271012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:47.272284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.280599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1048/2076] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:47.281386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.282782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.295714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee3695-733e-496f-a4b4-f1eaf73c6860 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.300542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1029/2077] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:46 2022] DELETE /identity/v3/users/c1bbb5456222458090e00ed1fbaaff10 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:47.301971 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4c1a-bd3a-4dd4-b898-e672db8e3dcd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.302272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4c1a-bd3a-4dd4-b898-e672db8e3dcd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.302552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4c1a-bd3a-4dd4-b898-e672db8e3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.304397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.305309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.305618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.305904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] PATH_INFO: `/v3/projects/0f9bb7dfd78c4c5886f1db45a886b3ff/users/5ec07b8bbecc45319086d517d9cca4f7/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.323030 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9bb7dfd78c4c5886f1db45a886b3ff, user_id=5ec07b8bbecc45319086d517d9cca4f7, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.330386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-bdad4c1a-bd3a-4dd4-b898-e672db8e3dcd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:47.330386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bdad4c1a-bd3a-4dd4-b898-e672db8e3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.330604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.391489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1030/2078] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:47.391489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c40e0-97d9-4c36-9065-f6618e89a4d8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.391489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c40e0-97d9-4c36-9065-f6618e89a4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.391489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c40e0-97d9-4c36-9065-f6618e89a4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.414473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3d5c40e0-97d9-4c36-9065-f6618e89a4d8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:47.416074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3d5c40e0-97d9-4c36-9065-f6618e89a4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.418191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1049/2079] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:47 2022] PUT /identity/v3/projects/0f9bb7dfd78c4c5886f1db45a886b3ff/users/5ec07b8bbecc45319086d517d9cca4f7/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:47.419032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.482946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1031/2080] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:47.484542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.484892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.485341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.497435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42f29a-51da-4b73-89d1-fa3a8dfb2a58 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.502436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.503099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.503386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.503667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.504438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:47.504766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.505875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:47.506375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.507086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.518184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1032/2081] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:47.528563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.528786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1050/2082] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:47.528893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.534217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.545527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1424b-46ff-44d7-bd80-62b3e3d2db14 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.550506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.551157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.551442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.551717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.555002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.555002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.587076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824001e-c63c-4e3c-ac0a-ee34baeaf81b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.590769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.591418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.591705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.592128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.604915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.604915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.616372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1033/2083] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:47.625061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.636795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130281e-c6e7-4251-9f36-9a45b28b8469 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.640925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.641587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.641872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.642299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.651763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.653231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.663626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1034/2084] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:47.664493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.665806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:47.679229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c390ba-c142-4892-a3fa-f8286b780e94 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.688841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.689851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.691144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.691144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] PATH_INFO: `/v3/users/ad194da67b5c48ab8af3d47087943370` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.691767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad194da67b5c48ab8af3d47087943370)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.693868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.750781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1051/2085] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:47 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:47.751985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:47.817046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d41a8-0166-43d2-8306-cf59809086a1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:47.822520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:47.823207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:47.823490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:47.823768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:47.824513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:47.826846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:47.998580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1052/2086] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:47 2022] POST /identity/v3/users => generated 283 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:48.002496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.015045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad194da67b5c48ab8af3d47087943370'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.016295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad194da67b5c48ab8af3d47087943370'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.018983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad194da67b5c48ab8af3d47087943370'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.019175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b1c48-c831-4cf9-b758-323606c990be admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.037015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.037536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.037922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.038122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.038826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.040494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:48.041054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad194da67b5c48ab8af3d47087943370'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.051201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad194da67b5c48ab8af3d47087943370'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.058707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1053/2087] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:48.064997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.068129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:48.092841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d072ed-0fb7-40cd-b670-bcb8386d564c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.100146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.100833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.101123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.101396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.102304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.104090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:48.122265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1054/2088] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:48.123256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.136178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7ec5-5140-4984-ad88-dd00014c2b0d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.141144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258476e-263c-49ce-8149-077df6c1ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.142634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258476e-263c-49ce-8149-077df6c1ceb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.143198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258476e-263c-49ce-8149-077df6c1ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.143314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258476e-263c-49ce-8149-077df6c1ceb1 admin admin] PATH_INFO: `/v3/projects/ebd2d24cb34b4d6a82c48bfff743a3fd/users/1d04eccd58c748b29c8011339262df9c/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.160411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258476e-263c-49ce-8149-077df6c1ceb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd2d24cb34b4d6a82c48bfff743a3fd, user_id=1d04eccd58c748b29c8011339262df9c, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.163074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258476e-263c-49ce-8149-077df6c1ceb1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:48.230631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1035/2089] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:47 2022] DELETE /identity/v3/users/ad194da67b5c48ab8af3d47087943370 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:48.231688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.233424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:48.305412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1055/2090] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:48 2022] PUT /identity/v3/projects/ebd2d24cb34b4d6a82c48bfff743a3fd/users/1d04eccd58c748b29c8011339262df9c/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:48.308258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd2e92-8568-4883-adac-4094fbe949f8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.309202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e675-275b-45aa-b2d0-13acd9a42fab None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.309563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e675-275b-45aa-b2d0-13acd9a42fab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.309910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e675-275b-45aa-b2d0-13acd9a42fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.334503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d8b9e675-275b-45aa-b2d0-13acd9a42fab None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:48.336004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d8b9e675-275b-45aa-b2d0-13acd9a42fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:48.380495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.381407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.381796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.382168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] PATH_INFO: `/v3/projects/9ee6c26076e647158211de0078d92d7e` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.383535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ee6c26076e647158211de0078d92d7e)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.385757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:48.408716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1056/2091] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:48.410279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.410567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.411093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.455704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] MFA Rules not processed for user `1d04eccd58c748b29c8011339262df9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:48.457223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:48.525298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1057/2092] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:48.526708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.529354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:48.564670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:48.586671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ee6c26076e647158211de0078d92d7e', 'request_id': 'req-8ba087ff-576e-4682-859e-50c04a6c99b7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.593858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ee6c26076e647158211de0078d92d7e', 'request_id': 'req-8ba087ff-576e-4682-859e-50c04a6c99b7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.595631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53154882-1856-4d30-8099-6b2f7747d31a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.602189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ee6c26076e647158211de0078d92d7e', 'request_id': 'req-8ba087ff-576e-4682-859e-50c04a6c99b7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.667819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.669149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.669979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.670602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.746608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] The token cache is being invalidate because project 9ee6c26076e647158211de0078d92d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:48.746905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.752562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:48.755814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1036/2093] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:48 2022] DELETE /identity/v3/projects/9ee6c26076e647158211de0078d92d7e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:48.760675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.760675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:48.853968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.855497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:48.871998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1058/2094] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:48.873153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:48.873270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba087ff-576e-4682-859e-50c04a6c99b7 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.880179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.881590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.882101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.882723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] PATH_INFO: `/v3/users/435715b0864a43bb969438fed060336a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.884653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] RBAC: Authorizing `identity:delete_user(user_id=435715b0864a43bb969438fed060336a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.885860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79a2d7-3607-4790-9008-45abac103915 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:48.887375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:48.891062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dec51-a534-4c1e-a77c-b7d82a568014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:48.892082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dec51-a534-4c1e-a77c-b7d82a568014 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:48.893025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dec51-a534-4c1e-a77c-b7d82a568014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:48.894178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dec51-a534-4c1e-a77c-b7d82a568014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:48.895199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dec51-a534-4c1e-a77c-b7d82a568014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:48.897335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dec51-a534-4c1e-a77c-b7d82a568014 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.050342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1059/2095] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:48 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:49.050342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.050342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.050342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.070820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:49.072184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.136099 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1060/2096] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:49.137978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.145080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.169155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14119a08-14c9-4173-a7a3-0c91b708f15b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.182769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad9bb7-f06d-4916-b29c-96aeb25aa944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.183465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9bb7-f06d-4916-b29c-96aeb25aa944 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.184199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9bb7-f06d-4916-b29c-96aeb25aa944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.184199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9bb7-f06d-4916-b29c-96aeb25aa944 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.184769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad9bb7-f06d-4916-b29c-96aeb25aa944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.186742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad9bb7-f06d-4916-b29c-96aeb25aa944 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.192963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:49.228009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435715b0864a43bb969438fed060336a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:49.229327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435715b0864a43bb969438fed060336a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:49.230088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435715b0864a43bb969438fed060336a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:49.247257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435715b0864a43bb969438fed060336a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:49.256508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435715b0864a43bb969438fed060336a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:49.339278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1061/2097] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:49.341314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c06b29-0e46-47e7-a53f-fb4dc7d65dfb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.341840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c06b29-0e46-47e7-a53f-fb4dc7d65dfb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.342335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c06b29-0e46-47e7-a53f-fb4dc7d65dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.371534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1037/2098] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:48 2022] DELETE /identity/v3/users/435715b0864a43bb969438fed060336a => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:49.373785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.374558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.378251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-24c06b29-0e46-47e7-a53f-fb4dc7d65dfb None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:49.382434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24c06b29-0e46-47e7-a53f-fb4dc7d65dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.461863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1062/2099] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:49.463252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.463726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.464461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.485197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eab6a-ee5f-4590-aa57-ca3500bc913f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.494916 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:49.495138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.496091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.496220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.496620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.497026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.497892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.499664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.536036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1063/2100] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:49.536036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.552670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dde27-3237-47e6-a098-6a2b710f82c4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.558495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1038/2101] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:49.560136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.561565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.563184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.563289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.563289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.563289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:49.563494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.563592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.565883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.580176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1064/2102] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:49.580176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.595876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a74ecd-46f5-4ef6-9d7c-251be6a85c07 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.601455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224523-71dc-4214-b0ee-893ac16eac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.602169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224523-71dc-4214-b0ee-893ac16eac5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.602489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224523-71dc-4214-b0ee-893ac16eac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.604275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224523-71dc-4214-b0ee-893ac16eac5e admin admin] PATH_INFO: `/v3/projects/553c797c734348f689a4323d9fc4571b/users/73bfee3d86ff4807ba45da81dbdf5064/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.626349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224523-71dc-4214-b0ee-893ac16eac5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=553c797c734348f689a4323d9fc4571b, user_id=73bfee3d86ff4807ba45da81dbdf5064, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.630032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224523-71dc-4214-b0ee-893ac16eac5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.642850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f265a-eb2b-4048-ba02-9aeaee49f53c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.646653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.647403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.647738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.647991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.657441 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.662262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.675236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1039/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:49.676287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.688794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431dc5b0-c749-4d77-929b-f6a7e9a77cad service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.695325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.696244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.696530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.696865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.697576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.699661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.770782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1065/2104] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:49 2022] PUT /identity/v3/projects/553c797c734348f689a4323d9fc4571b/users/73bfee3d86ff4807ba45da81dbdf5064/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:49.772379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.772379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.774392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.804076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] MFA Rules not processed for user `5ec07b8bbecc45319086d517d9cca4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:49.806583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.847557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1040/2105] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:49.847557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.848844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:49.880946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1066/2106] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:49.882130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.916378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cbbff-bf70-45fa-8029-c4f7b2dba47d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.921510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.922449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.922731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.923045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] PATH_INFO: `/v3/projects/debae12c6276456f83c8f2f95a85528f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.924762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=debae12c6276456f83c8f2f95a85528f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.926688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.947689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438fe9e-161a-4f52-8708-2a54584e4ec6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.952742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.953408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.953695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.953971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.955560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.957223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:49.967416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1067/2107] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:49.968287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:49.977769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26c5d7-e457-4a49-854f-553a516aa3c3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:49.983445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:49.983445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:49.983661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:49.983806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:49.984548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:49.986780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.062001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'debae12c6276456f83c8f2f95a85528f', 'request_id': 'req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.068856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'debae12c6276456f83c8f2f95a85528f', 'request_id': 'req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.075300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'debae12c6276456f83c8f2f95a85528f', 'request_id': 'req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.120765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1068/2108] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:49 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:50.120765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.120765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.179703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d48c-ddf4-4109-a8cc-55b78082b0a4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:50.193875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] The token cache is being invalidate because project debae12c6276456f83c8f2f95a85528f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:50.194213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.194876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.199748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1041/2109] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:49 2022] DELETE /identity/v3/projects/debae12c6276456f83c8f2f95a85528f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:50.199748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.199748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.236349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:50.237187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.237552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.237908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.239836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.281085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfde34b-d604-4f84-b6d2-3e98f562bbc0 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:50.286374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:50.287341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.287692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.288004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] PATH_INFO: `/v3/projects/553c797c734348f689a4323d9fc4571b/users/73bfee3d86ff4807ba45da81dbdf5064/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.291334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553c797c734348f689a4323d9fc4571b, user_id=73bfee3d86ff4807ba45da81dbdf5064, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:50.292872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.304740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1042/2110] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:50 2022] PUT /identity/v3/projects/553c797c734348f689a4323d9fc4571b/users/73bfee3d86ff4807ba45da81dbdf5064/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:50.305413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.306157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:50.307484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.307618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.319184 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1069/2111] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:50.320044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.321357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.335770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84f7b3-9c81-48ea-8f26-0ef123f91998 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:50.347162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:50.379908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc3ebf-4ecd-4638-8d86-f889afc4fb21 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:50.385979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:50.386881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.387292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.387716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.388590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:50.394826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.405647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:50.405647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.405647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.405647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] PATH_INFO: `/v3/users/eb5c9d2a8f584913809dd409171d94e1` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.406007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5c9d2a8f584913809dd409171d94e1)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:50.406007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.409801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1043/2112] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:50.410776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.412922 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.427451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aaf9b-8978-4dc8-9966-d6b047b8f0a9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:50.432563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:50.433350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.433635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.433911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] PATH_INFO: `/v3/projects/3e6c32cd0cba4b4596d24fde4208dac2` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.435097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6c32cd0cba4b4596d24fde4208dac2)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:50.437317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.623943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5c9d2a8f584913809dd409171d94e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.624157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6c32cd0cba4b4596d24fde4208dac2', 'request_id': 'req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.624624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5c9d2a8f584913809dd409171d94e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.625222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5c9d2a8f584913809dd409171d94e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.629568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6c32cd0cba4b4596d24fde4208dac2', 'request_id': 'req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.637137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5c9d2a8f584913809dd409171d94e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.637650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6c32cd0cba4b4596d24fde4208dac2', 'request_id': 'req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.644354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5c9d2a8f584913809dd409171d94e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.770120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] The token cache is being invalidate because project 3e6c32cd0cba4b4596d24fde4208dac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:50.770405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.771039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee7ddd2f-4424-4b11-b42b-4f2ccc183247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:50.772620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1044/2113] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:50 2022] DELETE /identity/v3/projects/3e6c32cd0cba4b4596d24fde4208dac2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:50.774682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbe17-9426-4676-a964-6b4ca52ffde2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.774915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbe17-9426-4676-a964-6b4ca52ffde2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.775187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafbe17-9426-4676-a964-6b4ca52ffde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.804587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3cafbe17-9426-4676-a964-6b4ca52ffde2 None None] MFA Rules not processed for user `73bfee3d86ff4807ba45da81dbdf5064`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:50.807623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3cafbe17-9426-4676-a964-6b4ca52ffde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.870059 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:50.882394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1070/2114] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:50 2022] DELETE /identity/v3/users/eb5c9d2a8f584913809dd409171d94e1 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:50.882394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.882394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.886346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1045/2115] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:50.892089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.892824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.893045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.916460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:50.918011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.969710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a319d7-ad50-40e9-b0cc-8961499afda5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:50.976127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d714047-f585-4cf2-8adf-91cb3138aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:50.976885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d714047-f585-4cf2-8adf-91cb3138aafa admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:50.977178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d714047-f585-4cf2-8adf-91cb3138aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:50.977461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d714047-f585-4cf2-8adf-91cb3138aafa admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:50.978600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d714047-f585-4cf2-8adf-91cb3138aafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:50.981272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d714047-f585-4cf2-8adf-91cb3138aafa admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:50.996792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1046/2116] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:50.996792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:50.996792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:50.997129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1071/2117] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:51.002968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.003427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.003774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.026257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:51.027490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:51.038422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1072/2118] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:51.040580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.045214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:51.060149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e04305-6e09-4090-af07-4d6f67024f99 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.065610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.066515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.066726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56b4e-aa38-4ec2-a2d4-1424a1028530 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.067124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.067717 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.073805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250de62-0af2-4367-a9bc-e8e4610b32c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.075150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250de62-0af2-4367-a9bc-e8e4610b32c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.075766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250de62-0af2-4367-a9bc-e8e4610b32c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.076280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250de62-0af2-4367-a9bc-e8e4610b32c2 admin admin] PATH_INFO: `/v3/projects/adc77c92c4fa46d19d574496346a5af4/users/2c622fb8933f482195b6ea07796f9934/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.098905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250de62-0af2-4367-a9bc-e8e4610b32c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc77c92c4fa46d19d574496346a5af4, user_id=2c622fb8933f482195b6ea07796f9934, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.118394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250de62-0af2-4367-a9bc-e8e4610b32c2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.168905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.170147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.185386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1047/2119] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:51.186038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.198707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e390e05-ff7f-4eaf-8a60-6604c3324e0b service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.205106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.205782 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.206555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.206859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.207751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:51.208087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.209692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.229552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1048/2120] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:51.230501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.242456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2add3-53c5-45f9-be73-e7aeed7fbbf9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.245005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1073/2121] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:51 2022] PUT /identity/v3/projects/adc77c92c4fa46d19d574496346a5af4/users/2c622fb8933f482195b6ea07796f9934/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:51.255686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.256248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.256727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.306831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] MFA Rules not processed for user `2c622fb8933f482195b6ea07796f9934`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:51.309198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:51.338000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.338850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.339150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.339434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.340201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.342598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.408475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1074/2122] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:51.419792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.481552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1049/2123] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:51 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:51.482676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.483436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f42eda-75ad-467e-b51b-1ceeca19a255 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.485105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:51.579699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.582044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.582404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.583111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.590988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c7ba5-e03e-44e1-8e88-6512d0d08727 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.597299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.598761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.599374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.599662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.602307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:51.653037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.654560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.667248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1075/2124] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:51.668622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.669976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.671805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.694586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1050/2125] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:51.694586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.696969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:51.761740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb350c-1262-4fd6-8a5d-44ca27ac2404 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.769718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.770519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.770932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.771217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.771948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.774769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.796111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18b15-b861-4f6b-baa7-02f4c70c813b service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.801479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.802603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.803389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.803389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] PATH_INFO: `/v3/projects/495d43b924f940f6a7c8b7763c87e1ee` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.804800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495d43b924f940f6a7c8b7763c87e1ee)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.810706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.926699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1076/2126] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:51 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:51.929580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:51.946507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ca89e-b06b-4d7d-95ed-5d64448724fd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:51.957025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:51.957921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:51.963567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:51.963567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] PATH_INFO: `/v3/users/2c622fb8933f482195b6ea07796f9934` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:51.963567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c622fb8933f482195b6ea07796f9934)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:51.965085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:51.981052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495d43b924f940f6a7c8b7763c87e1ee', 'request_id': 'req-403afeb3-aaef-44a6-ae6b-fffafc136028'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:51.991966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495d43b924f940f6a7c8b7763c87e1ee', 'request_id': 'req-403afeb3-aaef-44a6-ae6b-fffafc136028'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:51.994228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495d43b924f940f6a7c8b7763c87e1ee', 'request_id': 'req-403afeb3-aaef-44a6-ae6b-fffafc136028'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.074317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] The token cache is being invalidate because project 495d43b924f940f6a7c8b7763c87e1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:52.074596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.084526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.086817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1051/2127] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:51 2022] DELETE /identity/v3/projects/495d43b924f940f6a7c8b7763c87e1ee => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:52.087289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.091435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.182271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c622fb8933f482195b6ea07796f9934'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.183462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c622fb8933f482195b6ea07796f9934'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.185562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c622fb8933f482195b6ea07796f9934'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.185767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403afeb3-aaef-44a6-ae6b-fffafc136028 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:52.203476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c622fb8933f482195b6ea07796f9934'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.212200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b8227-468f-4ee7-b7dc-b46f20bec65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:52.212998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8227-468f-4ee7-b7dc-b46f20bec65a admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.213417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8227-468f-4ee7-b7dc-b46f20bec65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.213776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8227-468f-4ee7-b7dc-b46f20bec65a admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.214785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c622fb8933f482195b6ea07796f9934'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:52.216799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b8227-468f-4ee7-b7dc-b46f20bec65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:52.218654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b8227-468f-4ee7-b7dc-b46f20bec65a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:52.243208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1052/2128] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:52.244644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6550dd-231c-4c17-aa6a-a8e1a6749d0f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.244961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6550dd-231c-4c17-aa6a-a8e1a6749d0f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.245243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6550dd-231c-4c17-aa6a-a8e1a6749d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.267358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4d6550dd-231c-4c17-aa6a-a8e1a6749d0f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:52.268608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4d6550dd-231c-4c17-aa6a-a8e1a6749d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.276900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1053/2129] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:52.283404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039ba4a-61cf-4ec1-8ad8-838467cd0930 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.283404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039ba4a-61cf-4ec1-8ad8-838467cd0930 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.283404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039ba4a-61cf-4ec1-8ad8-838467cd0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.305402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2039ba4a-61cf-4ec1-8ad8-838467cd0930 None None] MFA Rules not processed for user `5ec07b8bbecc45319086d517d9cca4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:52.306652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2039ba4a-61cf-4ec1-8ad8-838467cd0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.316391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1077/2130] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:51 2022] DELETE /identity/v3/users/2c622fb8933f482195b6ea07796f9934 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:52.317639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.320183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.410631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1054/2131] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:52.412417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6de0-856d-49d0-bea1-527700013851 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.416948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6de0-856d-49d0-bea1-527700013851 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.416948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a6de0-856d-49d0-bea1-527700013851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.445710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e67a6de0-856d-49d0-bea1-527700013851 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:52.445710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e67a6de0-856d-49d0-bea1-527700013851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.454790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1055/2132] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:52.455046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad8395-76e9-4ac6-a162-9f33fc10c7db admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:52.456192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.456575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.457136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.463982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:52.464564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:52.465398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.465787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.466570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.467559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:52.469396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:52.493349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1078/2133] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:52.495518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.509891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:52.511286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.515294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945d6c9-c2b3-4a5c-a4a0-8c32ccebedc8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:52.528316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1056/2134] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:52.532010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.540019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:52.541021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.541324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.541595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.542336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:52.542644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:52.544455 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b84ff-84ff-4c80-8951-1156f1a95445 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:52.544956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:52.556535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:52.557596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.557981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.558358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] PATH_INFO: `/v3/projects/88a6c899dab54390bec72cf245479e1f/users/bc9c979aa8584ab2bd8ee67a6894ad30/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.572125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1079/2135] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:52.574069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.576761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:52.604553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a6c899dab54390bec72cf245479e1f, user_id=bc9c979aa8584ab2bd8ee67a6894ad30, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:52.608125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:52.708382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f722e-55d6-482c-9074-999e73c6cfc4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:52.737571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1057/2136] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:52 2022] PUT /identity/v3/projects/88a6c899dab54390bec72cf245479e1f/users/bc9c979aa8584ab2bd8ee67a6894ad30/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:52.739316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.785662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff37d1-1075-487c-b461-d94b5741deb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:52.786841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff37d1-1075-487c-b461-d94b5741deb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.787332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff37d1-1075-487c-b461-d94b5741deb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.787661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff37d1-1075-487c-b461-d94b5741deb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.831370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db79963-1a3d-46b9-98c3-6617d038a910 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:52.836504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:52.837532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.837532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.838132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.838638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:52.840807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:52.865500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff37d1-1075-487c-b461-d94b5741deb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:52.867278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dff37d1-1075-487c-b461-d94b5741deb1 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:52.874390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:52.880414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1080/2137] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:52.882024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:52.882317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:52.882598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:52.915310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1058/2138] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:52.919518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:52.935104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] MFA Rules not processed for user `bc9c979aa8584ab2bd8ee67a6894ad30`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:52.937616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:53.030632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b091ce6-220b-407f-b14e-0268c76650f0 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.032852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1081/2139] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:53.040440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.041205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.041563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.041911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.042693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.044781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.045034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.046508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:53.144904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6166b7-d4b1-413f-ab50-9c230267dcf2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.149590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.150273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.150569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.150851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.167213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1059/2140] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:52 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:53.175142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.189745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c43a3-946b-4d62-87ea-627fd34a254b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.197505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.198382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.198626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.199057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.199430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.200402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.201705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.203262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.217642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1060/2141] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:53.223424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.227001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1082/2142] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:53.237727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2efa9-4a10-4a68-8e9c-ebb027e25f82 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.244548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46021d5-27b3-41b5-974c-d470251784ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.245416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46021d5-27b3-41b5-974c-d470251784ab admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.249311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46021d5-27b3-41b5-974c-d470251784ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.249311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46021d5-27b3-41b5-974c-d470251784ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.249311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46021d5-27b3-41b5-974c-d470251784ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.249609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46021d5-27b3-41b5-974c-d470251784ab admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.265718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1061/2143] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:53.271998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.288427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9fe24-fdcf-432a-927b-4aef7d956f2a service glance] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.289536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.290428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.291075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.291361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] PATH_INFO: `/v3/projects/09a7966c74ad4497b8d70c2936c71876/users/9768d960c2574de883db9a514fa4f254/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.315726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a7966c74ad4497b8d70c2936c71876, user_id=9768d960c2574de883db9a514fa4f254, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.318916 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.405918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1083/2144] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:53 2022] PUT /identity/v3/projects/09a7966c74ad4497b8d70c2936c71876/users/9768d960c2574de883db9a514fa4f254/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:53.417954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.418406 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.418509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.423903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.426547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:53.508257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] MFA Rules not processed for user `9768d960c2574de883db9a514fa4f254`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:53.514017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:53.600774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a6d9-553a-4186-945c-244227531410 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.611734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.614161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.614694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.614976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] PATH_INFO: `/v3/projects/adc77c92c4fa46d19d574496346a5af4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.618027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc77c92c4fa46d19d574496346a5af4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.623159 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.663230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:53.671519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1062/2145] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:53.679784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.713941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025bed-eb5f-4c74-bf4a-71d2a7773ae4 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.721689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:53.723292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:53.724683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:53.725419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:53.727161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:53.731669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:53.795204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc77c92c4fa46d19d574496346a5af4', 'request_id': 'req-f60070c1-3d64-47ac-bcb7-8bf748a84b89'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:53.821454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc77c92c4fa46d19d574496346a5af4', 'request_id': 'req-f60070c1-3d64-47ac-bcb7-8bf748a84b89'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:53.876518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1063/2146] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:53 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:53.880503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:53.990118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eae8d8-738c-424b-bf9a-4c53b52722d5 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:53.999700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3179263-a81a-403f-8b48-e9a345a4f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.000850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179263-a81a-403f-8b48-e9a345a4f84b admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.001426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179263-a81a-403f-8b48-e9a345a4f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.002170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3179263-a81a-403f-8b48-e9a345a4f84b admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.003150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179263-a81a-403f-8b48-e9a345a4f84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.005515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3179263-a81a-403f-8b48-e9a345a4f84b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.037558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc77c92c4fa46d19d574496346a5af4', 'request_id': 'req-f60070c1-3d64-47ac-bcb7-8bf748a84b89'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:54.064783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] The token cache is being invalidate because project adc77c92c4fa46d19d574496346a5af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:54.065054 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:54.065960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f60070c1-3d64-47ac-bcb7-8bf748a84b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:54.068370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1084/2147] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:53 2022] DELETE /identity/v3/projects/adc77c92c4fa46d19d574496346a5af4 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:54.072519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.073042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.073277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.096127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:54.097676 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:54.109002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1085/2148] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:54.112763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1064/2149] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:53 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:54.117163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.118656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.118941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.119225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.120097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:54.144914 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:54.147671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:54.150777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dab629-f7f6-458f-8080-b1998672d33f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.158029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.159981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.160465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.161832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.163168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1065/2150] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:54.163889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.167732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.168530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.173921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce0f1-a838-4481-b852-82725bd9c3fd None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.183725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.185175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.185472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.185750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.186958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:54.187399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.191718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1086/2151] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:54.196535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.196858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.203320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1066/2152] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:54.207883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.211079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5c464-071d-40fc-b2f6-00c330e195c0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.216469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.217364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.217648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.217925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] PATH_INFO: `/v3/projects/ca5c9750c0c24e918e2e4a7af65322c0/users/d53a348e306141f3ade6745d1ff945ec/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.218621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3a963-98d3-4170-bc73-a8e243de4d6a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.224133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.224942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.225231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.225515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.226226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.228183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.250801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5c9750c0c24e918e2e4a7af65322c0, user_id=d53a348e306141f3ade6745d1ff945ec, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.254275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.315040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:54.336665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1067/2153] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:54 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:54.340976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.401460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1087/2154] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:54 2022] PUT /identity/v3/projects/ca5c9750c0c24e918e2e4a7af65322c0/users/d53a348e306141f3ade6745d1ff945ec/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:54.404251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.415158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeef49-340c-483b-94bb-97a87feca271 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.490254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371e34-6e9c-492d-9de1-5a6522487b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.492539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371e34-6e9c-492d-9de1-5a6522487b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.492885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371e34-6e9c-492d-9de1-5a6522487b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.493171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371e34-6e9c-492d-9de1-5a6522487b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.493940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8371e34-6e9c-492d-9de1-5a6522487b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.500579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8371e34-6e9c-492d-9de1-5a6522487b4f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.513630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:54.514373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387e8bc-a95e-4b39-bfb9-05ef92427ef6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.526679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.527521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.527896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.528325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.530943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.536128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.564012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1088/2155] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:54.567807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.582781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80598f0b-851c-415c-b9be-5f6a720b0872 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.588259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.589207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.589489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.589820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] PATH_INFO: `/v3/projects/ca5c9750c0c24e918e2e4a7af65322c0/users/d53a348e306141f3ade6745d1ff945ec/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.591977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5c9750c0c24e918e2e4a7af65322c0, user_id=d53a348e306141f3ade6745d1ff945ec, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.594815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.607078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1089/2156] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:54 2022] PUT /identity/v3/projects/ca5c9750c0c24e918e2e4a7af65322c0/users/d53a348e306141f3ade6745d1ff945ec/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:54.611402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1068/2157] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:54 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:54.615523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.618085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.618378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.618654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.689813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] MFA Rules not processed for user `d53a348e306141f3ade6745d1ff945ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:54.696457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:54.746137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5426d3-6acd-46d0-8af1-72c160df09f8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.755964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.756644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.756921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.757194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.757959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.759797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.779479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1090/2158] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:54.782026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.796618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb93dba-6ee9-4d2b-b161-dff4e00ce4fb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.804011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.805166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.809603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1069/2159] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:54.809721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.809895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.810796 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.813594 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.822677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.825096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:54.835793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1091/2160] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:54.839152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:54.852560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835c800-fdfb-43d2-bc6f-a1e6e8e027f3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.859940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.874520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.874520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.874520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] PATH_INFO: `/v3/projects/c426451f11774384bf4c3a398c6b6148/users/2a4affa624ca488ea407e01d51414d75/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.880441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c426451f11774384bf4c3a398c6b6148, user_id=2a4affa624ca488ea407e01d51414d75, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.883348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.896180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5094657-3975-4d80-beb5-15942d3ea3c9 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:54.899861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:54.900608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:54.900970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:54.901923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:54.903764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:54.966224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:54.967692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524779-bd73-415f-bd3d-a84902d05a53 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:54.976885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1070/2161] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:55.061993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1092/2162] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:54 2022] PUT /identity/v3/projects/c426451f11774384bf4c3a398c6b6148/users/2a4affa624ca488ea407e01d51414d75/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:55.063255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7996ef-b0dc-4242-b842-fb0f429ab7ab None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:55.064562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7996ef-b0dc-4242-b842-fb0f429ab7ab None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:55.064842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7996ef-b0dc-4242-b842-fb0f429ab7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:55.113467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8a7996ef-b0dc-4242-b842-fb0f429ab7ab None None] MFA Rules not processed for user `2a4affa624ca488ea407e01d51414d75`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:55.115461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8a7996ef-b0dc-4242-b842-fb0f429ab7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:55.215359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1071/2163] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:50:55.229086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:55.230938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:55.294386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36944-1d52-4211-bbc7-8ee67e37e22c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:55.298688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b4a63-b1db-4d3c-b812-2f508acbad05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:55.299334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4a63-b1db-4d3c-b812-2f508acbad05 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:55.299618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4a63-b1db-4d3c-b812-2f508acbad05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:55.299897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4a63-b1db-4d3c-b812-2f508acbad05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:55.308760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b4a63-b1db-4d3c-b812-2f508acbad05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:55.310198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b4a63-b1db-4d3c-b812-2f508acbad05 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:55.320175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1093/2164] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:56.359390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aeaa5-1feb-4185-98ed-aa17e8ec9bc1 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:56.359897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aeaa5-1feb-4185-98ed-aa17e8ec9bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:56.359897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aeaa5-1feb-4185-98ed-aa17e8ec9bc1 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:56.362149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1072/2165] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:50:56.400619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:56.400619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:56.400619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:56.437701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:56.439608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:56.510758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1094/2166] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:50:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:56.521840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aeaa5-1feb-4185-98ed-aa17e8ec9bc1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:56.523671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-846aeaa5-1feb-4185-98ed-aa17e8ec9bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:56.541531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aeaa5-1feb-4185-98ed-aa17e8ec9bc1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:56.550195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:56.550195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:56.550600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:56.551081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:56.555128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:56.556602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:56.564708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:56.566744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:56.584622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1073/2167] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:50:56.652584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79301e-a456-4e81-a997-1d4506031c18 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:56.658721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:56.659904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:56.660220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:56.660493 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] PATH_INFO: `/v3/users/ba34e08ed3594bc38a17abf6906b9b0b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:56.662320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba34e08ed3594bc38a17abf6906b9b0b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:56.664510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:56.949120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba34e08ed3594bc38a17abf6906b9b0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:56.949858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba34e08ed3594bc38a17abf6906b9b0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:56.950515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba34e08ed3594bc38a17abf6906b9b0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:56.967408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:56.968900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba34e08ed3594bc38a17abf6906b9b0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:56.976998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba34e08ed3594bc38a17abf6906b9b0b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:57.102620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:57.113392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f984073-9894-4aae-9ba9-b30b21cec32e service placement] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:57.117466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09984052-c10e-4497-953d-337477674004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:57.118163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1095/2168] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:56 2022] DELETE /identity/v3/users/ba34e08ed3594bc38a17abf6906b9b0b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:57.118463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09984052-c10e-4497-953d-337477674004 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:57.118913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09984052-c10e-4497-953d-337477674004 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:57.119187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09984052-c10e-4497-953d-337477674004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:57.121114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-09984052-c10e-4497-953d-337477674004 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:57.200755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09984052-c10e-4497-953d-337477674004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:57.202232 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09984052-c10e-4497-953d-337477674004 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:57.215482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1074/2169] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:57.365676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:50:57.449611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:57.453129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:57.583311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f5b81-91d3-4641-836b-e44c45a7ff7c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:57.588381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:57.590787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:57.590787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:57.590787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] PATH_INFO: `/v3/projects/dce28c0477dd488da533a8d7553bba88` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:57.591260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce28c0477dd488da533a8d7553bba88)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:57.593256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:57.733143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce28c0477dd488da533a8d7553bba88', 'request_id': 'req-dee012d7-ceed-4b94-8264-1972d3ada221'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:57.738922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce28c0477dd488da533a8d7553bba88', 'request_id': 'req-dee012d7-ceed-4b94-8264-1972d3ada221'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:57.828073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce28c0477dd488da533a8d7553bba88', 'request_id': 'req-dee012d7-ceed-4b94-8264-1972d3ada221'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:57.840179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] The token cache is being invalidate because project dce28c0477dd488da533a8d7553bba88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:50:57.840462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:57.841095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dee012d7-ceed-4b94-8264-1972d3ada221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:57.842661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1096/2170] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:50:57 2022] DELETE /identity/v3/projects/dce28c0477dd488da533a8d7553bba88 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:57.848657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:57.848954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:57.849264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:57.870079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:57.871311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:57.931402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1075/2171] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:57.939497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:57.939780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:57.940139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:57.960558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:57.961759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:57.970862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1097/2172] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:57.974823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:57.984642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89819b7-4bb0-484f-b456-2c0f0556e72d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:57.989941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:57.990629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:57.990912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:57.991189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:57.992228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:50:57.992542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:57.994239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.006784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1076/2173] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:50:58.011060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:58.020662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cbbf4-d1bc-43d3-b68e-f6ac0d942c86 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:58.025282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:58.026266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.026565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.026827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.027527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:58.031021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.304566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1098/2174] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:50:58 2022] POST /identity/v3/projects => generated 389 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:50:58.306069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:58.319970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ccf22-956a-4c34-bba7-a3aa706494d4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:58.382966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:58.383669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.384008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.384287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.385004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:58.387075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.509690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1077/2175] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:50:58 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:50:58.513611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:58.525979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8896-b84f-43f0-98ad-87ff104bfcc4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:58.532211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:58.533069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.533350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.533831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.534571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:58.536611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.550340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1099/2176] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:50:58.558515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:58.573631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e65cf-63d8-4178-a0c7-178fad5414b4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:58.578437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c53e7-a2f7-415e-95aa-11b80237461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:58.579189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c53e7-a2f7-415e-95aa-11b80237461f admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.579585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c53e7-a2f7-415e-95aa-11b80237461f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.579869 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c53e7-a2f7-415e-95aa-11b80237461f admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.580823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c53e7-a2f7-415e-95aa-11b80237461f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:58.582599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c53e7-a2f7-415e-95aa-11b80237461f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.598712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1078/2177] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:50:58.599871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:58.620292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73077a05-04ff-4b0f-aeb1-04f7342dfe0f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:58.630790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:58.632745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.633055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.633355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] PATH_INFO: `/v3/projects/f5f8cfe0ac66430eab8ee4d9a146d026/users/64a4e1770f3d4a79a7ae379184f094c3/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.676943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f8cfe0ac66430eab8ee4d9a146d026, user_id=64a4e1770f3d4a79a7ae379184f094c3, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:58.680947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.771072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1100/2178] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:50:58 2022] PUT /identity/v3/projects/f5f8cfe0ac66430eab8ee4d9a146d026/users/64a4e1770f3d4a79a7ae379184f094c3/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:50:58.776623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.776906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.777183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.796976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:58.798786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:58.862708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1079/2179] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:58.873219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:58.875053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:58.944216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d791bc-d67d-46ed-954f-a14f1a388a0d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:58.948221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fce79-e812-4688-b912-703796248b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:58.948877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fce79-e812-4688-b912-703796248b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:58.949168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fce79-e812-4688-b912-703796248b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:58.949449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fce79-e812-4688-b912-703796248b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:58.959293 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fce79-e812-4688-b912-703796248b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:58.960929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fce79-e812-4688-b912-703796248b04 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:58.971576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1101/2180] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:50:59.160405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:59.161855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:59.189166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c46c2-d976-440b-856c-064f6963aa17 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:59.200145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:59.201667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:59.202284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:59.202784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] PATH_INFO: `/v3/users/2a4affa624ca488ea407e01d51414d75` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:59.205188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4affa624ca488ea407e01d51414d75)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:59.208677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:59.433415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4affa624ca488ea407e01d51414d75'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:59.435762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4affa624ca488ea407e01d51414d75'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:59.436419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4affa624ca488ea407e01d51414d75'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:59.452047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4affa624ca488ea407e01d51414d75'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:59.462796 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4affa624ca488ea407e01d51414d75'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:50:59.558495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176a39-1894-4796-8d79-702670a386d3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:59.559378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176a39-1894-4796-8d79-702670a386d3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:59.559878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38176a39-1894-4796-8d79-702670a386d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:59.564021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1080/2181] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:50:59 2022] DELETE /identity/v3/users/2a4affa624ca488ea407e01d51414d75 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:50:59.586377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-38176a39-1894-4796-8d79-702670a386d3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:50:59.587656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38176a39-1894-4796-8d79-702670a386d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:59.654088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1102/2182] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:50:59.675349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:50:59.676911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:50:59.766849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137dc4f-51d6-43c2-b5fb-3e2bc6947484 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:50:59.771512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3590ce3-3ba8-4d20-a47f-285b88126f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:50:59.772231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3590ce3-3ba8-4d20-a47f-285b88126f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:50:59.772520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3590ce3-3ba8-4d20-a47f-285b88126f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:50:59.772856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3590ce3-3ba8-4d20-a47f-285b88126f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:50:59.786018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3590ce3-3ba8-4d20-a47f-285b88126f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:50:59.787637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3590ce3-3ba8-4d20-a47f-285b88126f51 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:50:59.806587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1081/2183] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:00.057398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176a39-1894-4796-8d79-702670a386d3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:00.058978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-38176a39-1894-4796-8d79-702670a386d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:00.075191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38176a39-1894-4796-8d79-702670a386d3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:00.081580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:00.082477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:00.082976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:00.083149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] PATH_INFO: `/v3/users/1d04eccd58c748b29c8011339262df9c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:00.084359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d04eccd58c748b29c8011339262df9c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:00.086482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:00.161936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:00.293325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d04eccd58c748b29c8011339262df9c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.293950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d04eccd58c748b29c8011339262df9c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.294635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d04eccd58c748b29c8011339262df9c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.307443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d04eccd58c748b29c8011339262df9c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.319156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d04eccd58c748b29c8011339262df9c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.413960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1103/2184] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:00 2022] DELETE /identity/v3/users/1d04eccd58c748b29c8011339262df9c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:00.418581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:00.418887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:00.419163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:00.439825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:00.444458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:00.484232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:00.490097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:00.502039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:00.514746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1082/2185] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:00.525228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:00.526851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:00.583023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71088419-0ebc-4797-857b-ffecc52e4247 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:00.588032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:00.589052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:00.589335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:00.589610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] PATH_INFO: `/v3/projects/c426451f11774384bf4c3a398c6b6148` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:00.590772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c426451f11774384bf4c3a398c6b6148)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:00.591379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cddee-a381-4d6a-a0a8-926133dc69e8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:00.593066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:00.595848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2381c-5b00-4752-a814-432286dcbafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:00.596621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2381c-5b00-4752-a814-432286dcbafb service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:00.596969 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2381c-5b00-4752-a814-432286dcbafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:00.597355 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2381c-5b00-4752-a814-432286dcbafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:00.607118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2381c-5b00-4752-a814-432286dcbafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:00.608592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2381c-5b00-4752-a814-432286dcbafb service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:00.619086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1083/2186] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:51:00.753549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c426451f11774384bf4c3a398c6b6148', 'request_id': 'req-5a463b01-e675-4a68-a48b-43b12b11bbdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.761163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c426451f11774384bf4c3a398c6b6148', 'request_id': 'req-5a463b01-e675-4a68-a48b-43b12b11bbdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.902532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c426451f11774384bf4c3a398c6b6148', 'request_id': 'req-5a463b01-e675-4a68-a48b-43b12b11bbdc'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.918027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] The token cache is being invalidate because project c426451f11774384bf4c3a398c6b6148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:00.918333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.919273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5a463b01-e675-4a68-a48b-43b12b11bbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:00.921699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1104/2187] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:00 2022] DELETE /identity/v3/projects/c426451f11774384bf4c3a398c6b6148 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:00.927276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:00.927857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:00.938133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:00.956543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:00.957912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:01.060448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1084/2188] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:01.069039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.069350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.069593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.096358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:01.098921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:01.110583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1105/2189] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:01.114814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.126389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70fe13-53a6-47db-98f5-f37ff907ae26 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.131709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.132507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.132791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.133069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.133877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:51:01.134173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.135898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.153945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1085/2190] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:51:01.158591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.168624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92fd3-e90f-49ba-ad92-2b451a4fe3d2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.174222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.174896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.175175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.175448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.176236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.178148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.316001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1106/2191] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:01 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:51:01.317653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.330124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740e2e7-02f0-4b84-bd7a-f606f96dc051 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.406954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.407992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.408413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.409012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.409524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.411601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.485785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.487639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:01.502254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484b17-262f-4880-86d3-c539fc289bcb admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.511139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.512110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.519223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.519223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] PATH_INFO: `/v3/projects/ebd2d24cb34b4d6a82c48bfff743a3fd` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.519223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd2d24cb34b4d6a82c48bfff743a3fd)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.519223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.559741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1086/2192] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:01 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:51:01.559741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.562634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb44d9e-655d-4cec-82c9-bfe5ffcf8624 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.568741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.569488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.569771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.570049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.570784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.572454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.585791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1087/2193] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:51:01.589425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.600110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c005783-3259-4935-bc1d-45628be3302c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.604980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.605700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.606057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.606506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.607462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.609053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.624025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1088/2194] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:51:01.628349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.639178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502af2d-adeb-4b84-819c-017330aa743e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:01.644186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5008a2-53e1-45ce-9fdc-64430b594eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:01.645098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5008a2-53e1-45ce-9fdc-64430b594eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.645382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5008a2-53e1-45ce-9fdc-64430b594eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.645658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5008a2-53e1-45ce-9fdc-64430b594eea admin admin] PATH_INFO: `/v3/projects/9c5bfecd179f421abcb38d2db9ed2885/users/5dc099ed567c491ca4fb399c14083762/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.666057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5008a2-53e1-45ce-9fdc-64430b594eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5bfecd179f421abcb38d2db9ed2885, user_id=5dc099ed567c491ca4fb399c14083762, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:01.669035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5008a2-53e1-45ce-9fdc-64430b594eea admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:01.759954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1089/2195] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:01 2022] PUT /identity/v3/projects/9c5bfecd179f421abcb38d2db9ed2885/users/5dc099ed567c491ca4fb399c14083762/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:01.759954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:01.759954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:01.759954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:01.792277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd2d24cb34b4d6a82c48bfff743a3fd', 'request_id': 'req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:01.802938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd2d24cb34b4d6a82c48bfff743a3fd', 'request_id': 'req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:01.828229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] MFA Rules not processed for user `5dc099ed567c491ca4fb399c14083762`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:01.830117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:01.925063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd2d24cb34b4d6a82c48bfff743a3fd', 'request_id': 'req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:01.940331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] The token cache is being invalidate because project ebd2d24cb34b4d6a82c48bfff743a3fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:01.941022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:01.942123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:01.946843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1107/2196] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:01 2022] DELETE /identity/v3/projects/ebd2d24cb34b4d6a82c48bfff743a3fd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:51:01.947010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1090/2197] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:01.950373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.950373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:01.960568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:01.962413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:02.052757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4ff1-68c1-4a11-9c40-7b0b13fe7c87 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:02.057269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:02.057931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:02.059495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:02.059495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:02.060500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:02.063656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae824a0d-45db-45bd-8ca2-aa1688e7a9b3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:02.070300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:02.071671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:02.072066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:02.072460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] PATH_INFO: `/v3/users/73bfee3d86ff4807ba45da81dbdf5064` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:02.073888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73bfee3d86ff4807ba45da81dbdf5064)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:02.074817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:02.076081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:02.076672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:02.089424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1091/2198] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:51:02.153409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:02.155423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:02.176733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e7c2f-4beb-4fb3-bcd6-55eee151dfb5 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:02.185569 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:02.186405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:02.186691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:02.186973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] PATH_INFO: `/v3/users/9768d960c2574de883db9a514fa4f254` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:02.188278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9768d960c2574de883db9a514fa4f254)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:02.190330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:02.319036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73bfee3d86ff4807ba45da81dbdf5064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.319725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73bfee3d86ff4807ba45da81dbdf5064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.320547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73bfee3d86ff4807ba45da81dbdf5064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.338331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73bfee3d86ff4807ba45da81dbdf5064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.346703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0aed0b90-8031-4165-881a-9f1920995ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73bfee3d86ff4807ba45da81dbdf5064'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.427016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9768d960c2574de883db9a514fa4f254'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.427934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9768d960c2574de883db9a514fa4f254'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.428689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9768d960c2574de883db9a514fa4f254'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.451286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9768d960c2574de883db9a514fa4f254'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.470339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1108/2199] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:01 2022] DELETE /identity/v3/users/73bfee3d86ff4807ba45da81dbdf5064 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:02.487360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9768d960c2574de883db9a514fa4f254'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:02.600288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1092/2200] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:02 2022] DELETE /identity/v3/users/9768d960c2574de883db9a514fa4f254 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:51:02.604825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19404-c084-472a-a431-48402a84711a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:02.605171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19404-c084-472a-a431-48402a84711a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:02.605452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19404-c084-472a-a431-48402a84711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:02.633906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-93d19404-c084-472a-a431-48402a84711a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:02.635189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93d19404-c084-472a-a431-48402a84711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:02.738341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1109/2201] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:02.748317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:02.749774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:02.847617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc8bb5-8490-4cd0-9eb9-9c6b4ee57ce3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:02.852004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:02.852677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:02.852960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:02.853544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:02.869606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:02.871136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:02.887348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1093/2202] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:02.993696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:03.183103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19404-c084-472a-a431-48402a84711a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:03.189633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-93d19404-c084-472a-a431-48402a84711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:03.226079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19404-c084-472a-a431-48402a84711a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:03.236456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:03.256497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:03.258847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:03.259142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:03.259429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] PATH_INFO: `/v3/projects/553c797c734348f689a4323d9fc4571b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:03.260866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553c797c734348f689a4323d9fc4571b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:03.262832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:03.448554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553c797c734348f689a4323d9fc4571b', 'request_id': 'req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.454993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553c797c734348f689a4323d9fc4571b', 'request_id': 'req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.515354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:03.516649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:03.530800 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5504c-e739-41b4-8e3b-5094031629b5 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:03.537010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553c797c734348f689a4323d9fc4571b', 'request_id': 'req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.553130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] The token cache is being invalidate because project 553c797c734348f689a4323d9fc4571b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:03.553431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.554602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e0a9f0ab-2f1a-423d-bbb4-2326cc8e2d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.556235 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1110/2203] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:03 2022] DELETE /identity/v3/projects/553c797c734348f689a4323d9fc4571b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:03.566742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b25e-1ea1-43f7-8edc-381bd13336fd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:03.571702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b25e-1ea1-43f7-8edc-381bd13336fd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:03.571702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b25e-1ea1-43f7-8edc-381bd13336fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:03.589921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7b58b25e-1ea1-43f7-8edc-381bd13336fd None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:03.591538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7b58b25e-1ea1-43f7-8edc-381bd13336fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:03.608368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:03.609293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:03.609574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:03.609906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] PATH_INFO: `/v3/projects/09a7966c74ad4497b8d70c2936c71876` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:03.611832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a7966c74ad4497b8d70c2936c71876)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:03.613820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:03.670466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1111/2204] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:03.679069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:03.679457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:03.679816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:03.701687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:03.702923 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:03.712251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1112/2205] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:03.716572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:03.726868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478ec1d-e11c-44cb-80b4-61143a84c8c8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:03.732061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:03.732759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:03.733064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:03.733342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:03.734980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:51:03.734980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:03.736226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:03.754667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1113/2206] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:51:03.755694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:03.767077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cdea7-aa5f-4849-82fe-a6ff58bade83 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:03.778345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:03.779039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:03.779330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:03.779628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:03.780431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:03.783205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:03.829973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a7966c74ad4497b8d70c2936c71876', 'request_id': 'req-f0431c0b-e44c-45ab-9063-e139502684f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.836618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a7966c74ad4497b8d70c2936c71876', 'request_id': 'req-f0431c0b-e44c-45ab-9063-e139502684f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.844900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a7966c74ad4497b8d70c2936c71876', 'request_id': 'req-f0431c0b-e44c-45ab-9063-e139502684f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.973415 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1114/2207] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:03 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:03.974610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] The token cache is being invalidate because project 09a7966c74ad4497b8d70c2936c71876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:03.975019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.976021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:03.977307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:03.979192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:03.996921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1094/2208] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:03 2022] DELETE /identity/v3/projects/09a7966c74ad4497b8d70c2936c71876 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:03.998025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:04.001259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:04.104772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d446d01-2d34-4ee3-a6fd-106860c4ad27 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:04.119780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:04.120507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.121021 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.121311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:04.122027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:04.124081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:04.139948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0431c0b-e44c-45ab-9063-e139502684f7 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:04.173221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:04.174349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.174793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.175216 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] PATH_INFO: `/v3/users/d53a348e306141f3ade6745d1ff945ec` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:04.177921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53a348e306141f3ade6745d1ff945ec)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:04.180295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:04.248940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1115/2209] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:03 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:04.261287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:04.278775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665e794-ad80-48c9-b3d5-3acb95f0f0d4 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:04.286190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:04.286882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.287310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.287791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:04.288795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:04.291246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:04.307850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1116/2210] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:04.313077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:04.330480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f8260-bf63-4068-b020-996f8b14ec6d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:04.338682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:04.339350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.339639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.339943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:04.340775 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:04.343678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:04.367401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1117/2211] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:04.373444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:04.378662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53a348e306141f3ade6745d1ff945ec'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:04.379691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53a348e306141f3ade6745d1ff945ec'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:04.380424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53a348e306141f3ade6745d1ff945ec'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:04.396856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c65667-36c7-48c7-977f-0ae142ad0b47 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:04.412098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:04.413108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.413348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.413636 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] PATH_INFO: `/v3/projects/8c4c8ef622d34e0cb1cba21a04901e43/users/fe37cc9571714a83ad8d3a0f0d36b6b8/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:04.424476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53a348e306141f3ade6745d1ff945ec'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:04.449603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6bbd3192-13fc-4f97-87ff-f9ec6e12b62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53a348e306141f3ade6745d1ff945ec'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:04.488671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c4c8ef622d34e0cb1cba21a04901e43, user_id=fe37cc9571714a83ad8d3a0f0d36b6b8, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:04.494398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:04.539419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1095/2212] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:03 2022] DELETE /identity/v3/users/d53a348e306141f3ade6745d1ff945ec => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:04.645453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1118/2213] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:04 2022] PUT /identity/v3/projects/8c4c8ef622d34e0cb1cba21a04901e43/users/fe37cc9571714a83ad8d3a0f0d36b6b8/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:04.658345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.662152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.662562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:04.726196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:04.728807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:04.853490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1096/2214] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:04.874621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:04.883490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:04.989840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b52c25-37ca-4917-a24d-2306b6c88368 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:04.994434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedef3a-b80a-4ef3-92d1-26a38af30e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:04.998327 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedef3a-b80a-4ef3-92d1-26a38af30e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:04.998686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedef3a-b80a-4ef3-92d1-26a38af30e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:04.999596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedef3a-b80a-4ef3-92d1-26a38af30e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:05.002210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:05.013164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedef3a-b80a-4ef3-92d1-26a38af30e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:05.014707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedef3a-b80a-4ef3-92d1-26a38af30e10 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:05.027164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1119/2215] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:05.231651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:05.233933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:05.273661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df0c4-23ef-4bee-921d-712c8600b722 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:05.281205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:05.282949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:05.283399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:05.283899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] PATH_INFO: `/v3/projects/ca5c9750c0c24e918e2e4a7af65322c0` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:05.286934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5c9750c0c24e918e2e4a7af65322c0)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:05.289623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:05.516059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5c9750c0c24e918e2e4a7af65322c0', 'request_id': 'req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:05.524482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5c9750c0c24e918e2e4a7af65322c0', 'request_id': 'req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:05.534230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5c9750c0c24e918e2e4a7af65322c0', 'request_id': 'req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:05.614495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] The token cache is being invalidate because project ca5c9750c0c24e918e2e4a7af65322c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:05.614918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:05.616518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-dfbd83a9-2059-4b6c-83d3-22219cc8dcf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:05.619021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1097/2216] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:05 2022] DELETE /identity/v3/projects/ca5c9750c0c24e918e2e4a7af65322c0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:05.625010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:05.626118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:05.626547 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:05.649362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:05.650599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:05.732090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1120/2217] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:05.742204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:05.742848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:05.743583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:05.804160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:05.807765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:05.829647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1098/2218] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:05.834275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:05.851329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51688d-a3e7-4ec0-af46-7b8cc8c92d7a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:05.857483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:05.859519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:05.859519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:05.860602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:05.861545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:51:05.861920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:05.864798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:05.894311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1121/2219] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:51:05.899007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:05.910752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24283a2a-782e-4ed6-8b94-7b5f3a7c53ab None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:05.917218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:05.919388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:05.920119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:05.920972 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:05.921892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:05.926515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:06.038392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1099/2220] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:05 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:06.042855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:06.054219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51352b7b-cb1f-475c-98db-377bed05d193 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:06.166072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:06.167604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:06.167895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:06.168527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:06.169304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:06.171999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:06.301408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1122/2221] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:06 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:51:06.302180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:06.319856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234705-1c77-4634-8413-10f45a1da388 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:06.342507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:06.347501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:06.347790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:06.348103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:06.354079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:06.354079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:06.368693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1100/2222] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:06.372518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:06.391463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac99ce-d7af-457d-9e10-07d06c9a5265 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:06.396869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa11c40-1174-4de5-93dc-6c99140bf2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:06.397563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa11c40-1174-4de5-93dc-6c99140bf2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:06.397845 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa11c40-1174-4de5-93dc-6c99140bf2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:06.398386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa11c40-1174-4de5-93dc-6c99140bf2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:06.399150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa11c40-1174-4de5-93dc-6c99140bf2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:06.411384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa11c40-1174-4de5-93dc-6c99140bf2cf admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:06.422993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1123/2223] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:06.427108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:06.445755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5b9a7-9fca-46e8-9059-5f8451da85fe admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:06.458672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:06.459944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:06.460387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:06.460890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] PATH_INFO: `/v3/projects/c38c2350b3e447eaa0872ac1017fc711/users/c2569109fb40431ca4d4cd9e4d46a90e/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:06.482230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38c2350b3e447eaa0872ac1017fc711, user_id=c2569109fb40431ca4d4cd9e4d46a90e, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:06.487208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:06.583633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1101/2224] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:06 2022] PUT /identity/v3/projects/c38c2350b3e447eaa0872ac1017fc711/users/c2569109fb40431ca4d4cd9e4d46a90e/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:06.595884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abd72-135f-411e-93b9-5cd5423194d2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:06.597153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abd72-135f-411e-93b9-5cd5423194d2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:06.597452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452abd72-135f-411e-93b9-5cd5423194d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:06.652118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-452abd72-135f-411e-93b9-5cd5423194d2 None None] MFA Rules not processed for user `c2569109fb40431ca4d4cd9e4d46a90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:06.653946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-452abd72-135f-411e-93b9-5cd5423194d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:06.866764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1124/2225] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:06.871138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:06.999164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c1f84-b15d-4ede-8aaf-18b89e48266c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.005534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.006219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.006696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.007140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.007873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.010056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.077817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66fbf-e294-412d-b41d-9dfd8bd98ebb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.078125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66fbf-e294-412d-b41d-9dfd8bd98ebb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.078598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d66fbf-e294-412d-b41d-9dfd8bd98ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.132275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f5d66fbf-e294-412d-b41d-9dfd8bd98ebb None None] MFA Rules not processed for user `64a4e1770f3d4a79a7ae379184f094c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:07.133769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5d66fbf-e294-412d-b41d-9dfd8bd98ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:07.134654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1102/2226] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:06 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:07.140614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.225575 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:07.315574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1125/2227] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:07.315814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e47d1f-c8c3-415b-abfe-134b75324025 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.315814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.315814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.315814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.316171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.316171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.318097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0a28-a4f6-4c3c-82ac-5511b09edb3e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.318225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.318319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0a28-a4f6-4c3c-82ac-5511b09edb3e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.318319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef0a28-a4f6-4c3c-82ac-5511b09edb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.341294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6cef0a28-a4f6-4c3c-82ac-5511b09edb3e None None] MFA Rules not processed for user `64a4e1770f3d4a79a7ae379184f094c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:07.344798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6cef0a28-a4f6-4c3c-82ac-5511b09edb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:07.351373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1126/2228] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:07.352621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.352910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.353188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.389455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] MFA Rules not processed for user `fe37cc9571714a83ad8d3a0f0d36b6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:07.390952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:07.470494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1103/2229] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:51:07.470494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.470912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:07.503960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1127/2230] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:07.503960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.516533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2c5e5-a8b9-4d59-9ea2-23e1bd42ff14 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.521668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.522357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.522671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.522952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.524281 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.525938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.546194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1128/2231] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:07.546194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.548945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:07.566393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91798fc6-8c13-44b4-bd4e-2832ddc63022 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.571496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.575463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.575463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.575463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.576682 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.578057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.587966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab8f75-6aac-48ac-9ae1-d9b7f3b76f00 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.595554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.596269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.596669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.596833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.607274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.609129 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.619902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1104/2232] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:07.620995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.632533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42293106-908b-42fe-98e3-a8819990f677 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.638606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.639294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.639580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.639859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.640634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.642821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.654659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1105/2233] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:07.659241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.669773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a03e5-bdeb-4f32-bcdf-18712215a67e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.675420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d060286-8565-4921-8f0b-d358a87314a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.676358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060286-8565-4921-8f0b-d358a87314a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.676639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060286-8565-4921-8f0b-d358a87314a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.691333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d060286-8565-4921-8f0b-d358a87314a1 admin admin] PATH_INFO: `/v3/projects/1be3edd4405e40fcb29d339a5e465081/users/c37ffe84922d4b6a874bc46a86988d2a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.695162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d060286-8565-4921-8f0b-d358a87314a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be3edd4405e40fcb29d339a5e465081, user_id=c37ffe84922d4b6a874bc46a86988d2a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.698003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d060286-8565-4921-8f0b-d358a87314a1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.718606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1129/2234] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:07.723805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.793759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1106/2235] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:07 2022] PUT /identity/v3/projects/1be3edd4405e40fcb29d339a5e465081/users/c37ffe84922d4b6a874bc46a86988d2a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:07.809758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.810174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1be298-adf5-43e5-9b6f-a93afc4c08b1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.810526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.814518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.867495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] MFA Rules not processed for user `c37ffe84922d4b6a874bc46a86988d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:07.867699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:07.869081 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:07.908714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.909505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.909861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.910212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.911334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.913586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:07.946590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1107/2236] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:07.951802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:07.963632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5ca71-115c-4353-b9a7-1f202376d548 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:07.968460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:07.969661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:07.969927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:07.970201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:07.970904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:07.972877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.059839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1130/2237] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/users => generated 292 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:08.062288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1108/2238] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:51:08.063683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.066545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.076456 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf58c88-e751-4065-a876-6add2c8c014b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.171240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2216cd0-def6-4455-8c66-3bd962bdbe1a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.174654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.175574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.176335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.176620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.177343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.179119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.179414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.180972 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.181689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.182118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.183194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.185718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.208241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1109/2239] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:08.209514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.227402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72899ccd-2656-45cd-b5e1-c561e826ad25 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.232849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.234041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.235053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.235386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] PATH_INFO: `/v3/projects/447a72e4c49e4576a14a96fea545cc7c/users/24dad38fbec546b3a1945f253b94400d/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.259567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] RBAC: Authorizing `identity:create_grant(project_id=447a72e4c49e4576a14a96fea545cc7c, user_id=24dad38fbec546b3a1945f253b94400d, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.262841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.279965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1131/2240] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:08 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:51:08.285254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.296285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be1329-a78c-437f-8a2d-5054ebed2e3e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.309942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.310873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.311294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.311728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.314383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.316103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.343236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1132/2241] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:51:08.361647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.376062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b8e2-b4fc-405d-81ef-cb70b6d775dc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.376649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1110/2242] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:08 2022] PUT /identity/v3/projects/447a72e4c49e4576a14a96fea545cc7c/users/24dad38fbec546b3a1945f253b94400d/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:51:08.381095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.525955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3047818-e4bb-40a8-9352-21b26aa4748c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.537440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.537440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.537440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.537440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.538410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.538410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.571635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.574328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.574695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.575452 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] PATH_INFO: `/v3/projects/8f25524727b044f8b85466fb5b1d2e3b/users/6ba57670e7724a1d80d051cf8c0a0278/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.576726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1111/2243] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:51:08.591874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.624611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ed3d-bda7-4498-b405-3d0756a638f9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.641654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f25524727b044f8b85466fb5b1d2e3b, user_id=6ba57670e7724a1d80d051cf8c0a0278, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.655234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.655327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b0096-8cc8-4646-8fed-b21de1714c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.655327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b0096-8cc8-4646-8fed-b21de1714c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.655327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b0096-8cc8-4646-8fed-b21de1714c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.655327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b0096-8cc8-4646-8fed-b21de1714c26 admin admin] PATH_INFO: `/v3/projects/447a72e4c49e4576a14a96fea545cc7c/users/24dad38fbec546b3a1945f253b94400d/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.658345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b0096-8cc8-4646-8fed-b21de1714c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447a72e4c49e4576a14a96fea545cc7c, user_id=24dad38fbec546b3a1945f253b94400d, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.667031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b0096-8cc8-4646-8fed-b21de1714c26 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.692856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1112/2244] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:08 2022] PUT /identity/v3/projects/447a72e4c49e4576a14a96fea545cc7c/users/24dad38fbec546b3a1945f253b94400d/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:08.694273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.694568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.694852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.748485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] MFA Rules not processed for user `64a4e1770f3d4a79a7ae379184f094c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:08.750952 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:08.757701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1133/2245] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:08 2022] PUT /identity/v3/projects/8f25524727b044f8b85466fb5b1d2e3b/users/6ba57670e7724a1d80d051cf8c0a0278/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:08.758523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.860704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1113/2246] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:08.897710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95576f92-ad13-4524-8d56-bf36063fc863 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:08.903813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b9f33-8d98-41df-b294-6b344383a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:08.905400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9f33-8d98-41df-b294-6b344383a064 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:08.905875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9f33-8d98-41df-b294-6b344383a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:08.907087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9f33-8d98-41df-b294-6b344383a064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:08.908080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b9f33-8d98-41df-b294-6b344383a064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:08.910436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b9f33-8d98-41df-b294-6b344383a064 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:08.990219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:08.995651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1134/2247] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:51:09.011544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22d3b-1c60-4dde-83a6-81fe445ba963 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:09.027438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:09.028457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:09.028803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:09.029150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] PATH_INFO: `/v3/projects/8f25524727b044f8b85466fb5b1d2e3b/users/6ba57670e7724a1d80d051cf8c0a0278/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:09.032460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f25524727b044f8b85466fb5b1d2e3b, user_id=6ba57670e7724a1d80d051cf8c0a0278, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:09.037331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:09.131957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1114/2248] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:08 2022] PUT /identity/v3/projects/8f25524727b044f8b85466fb5b1d2e3b/users/6ba57670e7724a1d80d051cf8c0a0278/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:51:09.142561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e37bd-0ec9-471b-827c-a2ae599e0f5d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:09.142850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e37bd-0ec9-471b-827c-a2ae599e0f5d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:09.143305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e37bd-0ec9-471b-827c-a2ae599e0f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:09.199429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c81e37bd-0ec9-471b-827c-a2ae599e0f5d None None] MFA Rules not processed for user `6ba57670e7724a1d80d051cf8c0a0278`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:09.201885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c81e37bd-0ec9-471b-827c-a2ae599e0f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:09.384800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1135/2249] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:09.412536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:09.414704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:09.526029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ef76c-da77-48db-8aa6-3f15f229ec7a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:09.530499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b951b40-4fc3-4785-8bc2-052340b8d5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:09.532403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951b40-4fc3-4785-8bc2-052340b8d5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:09.532714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951b40-4fc3-4785-8bc2-052340b8d5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:09.532998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b951b40-4fc3-4785-8bc2-052340b8d5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:09.550277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951b40-4fc3-4785-8bc2-052340b8d5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:09.551825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b951b40-4fc3-4785-8bc2-052340b8d5d7 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:09.565492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1115/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:51:10.269323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:10.925582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:11.209409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:11.209710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:11.209989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:11.282185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] MFA Rules not processed for user `24dad38fbec546b3a1945f253b94400d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:11.284260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:11.446053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1136/2251] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:11.450837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:11.451444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:11.451444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:11.493519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] MFA Rules not processed for user `fe37cc9571714a83ad8d3a0f0d36b6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:11.495175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:11.670208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1116/2252] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:11.690384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:11.692649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:11.705843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:11.732936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d607bc-347d-4d7d-94d3-ee9758e6519d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:11.744954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8727-92b1-4cc6-9333-ac68b6512e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:11.745732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8727-92b1-4cc6-9333-ac68b6512e5a service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:11.746054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8727-92b1-4cc6-9333-ac68b6512e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:11.746367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8727-92b1-4cc6-9333-ac68b6512e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:11.854477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdcee4-b03a-448b-ae2d-52f86b00d254 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:11.864585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:11.866479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:11.866719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8727-92b1-4cc6-9333-ac68b6512e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:11.868317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8727-92b1-4cc6-9333-ac68b6512e5a service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:11.868631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:11.869591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:11.881573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:11.883204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:11.892347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1117/2253] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:11.895294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1137/2254] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:12.214704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:12.638068 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:14.909134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:15.341632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:15.534281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:15.820506 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ff5c-b905-4884-9cbc-486a8e96a692 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:15.820953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ff5c-b905-4884-9cbc-486a8e96a692 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:15.822522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930ff5c-b905-4884-9cbc-486a8e96a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:15.854612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-3930ff5c-b905-4884-9cbc-486a8e96a692 None None] MFA Rules not processed for user `5ec07b8bbecc45319086d517d9cca4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:15.855875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-3930ff5c-b905-4884-9cbc-486a8e96a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:15.944151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1118/2255] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:16.453525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:17.033428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:17.035499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:17.269970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db405daa-da3f-48c3-9659-575ca8597c86 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:17.280976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:17.282239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:17.282701 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:17.283125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] PATH_INFO: `/v3/users/5dc099ed567c491ca4fb399c14083762` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:17.285853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc099ed567c491ca4fb399c14083762)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:17.291101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:17.707307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc099ed567c491ca4fb399c14083762'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:17.712898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc099ed567c491ca4fb399c14083762'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:17.712898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc099ed567c491ca4fb399c14083762'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:17.731731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc099ed567c491ca4fb399c14083762'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:17.749283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc099ed567c491ca4fb399c14083762'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:17.843261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1138/2256] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:17 2022] DELETE /identity/v3/users/5dc099ed567c491ca4fb399c14083762 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:17.848837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:17.849656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:17.850130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:17.877907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:17.879667 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:17.970794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1119/2257] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:18.006464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:18.008130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:18.021269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:18.025282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:18.075635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:18.148218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff8694-bd7b-427f-b5be-6c09a521c5af None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:18.155708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:18.163880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:18.163880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:18.163880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:18.190692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:18.194834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:18.197871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ad26a-3b76-4bc4-b4c6-e343d15fbb8a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:18.204941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:18.206075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:18.206583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:18.206876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:18.209146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:18.215767 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1120/2258] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:18.300400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:18.302248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:18.317823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1139/2259] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:19.303239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:19.308369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:19.308369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:19.324888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5d25-9808-475c-b14d-9e84216e0734 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:19.331390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:19.332684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:19.333032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:19.333540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] PATH_INFO: `/v3/projects/9c5bfecd179f421abcb38d2db9ed2885` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:19.335013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5bfecd179f421abcb38d2db9ed2885)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:19.337174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:19.515904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5bfecd179f421abcb38d2db9ed2885', 'request_id': 'req-42353459-aab8-429c-afa3-b31f92cb7cf2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:19.522868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5bfecd179f421abcb38d2db9ed2885', 'request_id': 'req-42353459-aab8-429c-afa3-b31f92cb7cf2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:19.529608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5bfecd179f421abcb38d2db9ed2885', 'request_id': 'req-42353459-aab8-429c-afa3-b31f92cb7cf2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:19.612809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] The token cache is being invalidate because project 9c5bfecd179f421abcb38d2db9ed2885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:19.613541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:19.614833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-42353459-aab8-429c-afa3-b31f92cb7cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:19.620122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1121/2260] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:19 2022] DELETE /identity/v3/projects/9c5bfecd179f421abcb38d2db9ed2885 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:20.689399 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:21.815710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:23.375904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:23.563385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:23.564596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:23.578856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812b17d-8091-4d91-b6d1-74280d9cd4ca service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:23.638485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:23.639292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:23.639579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:23.640420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] PATH_INFO: `/v3/users/c2569109fb40431ca4d4cd9e4d46a90e` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:23.641758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2569109fb40431ca4d4cd9e4d46a90e)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:23.643710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:23.881957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2569109fb40431ca4d4cd9e4d46a90e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:23.882799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2569109fb40431ca4d4cd9e4d46a90e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:23.883632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2569109fb40431ca4d4cd9e4d46a90e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:23.898211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2569109fb40431ca4d4cd9e4d46a90e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:23.907212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2569109fb40431ca4d4cd9e4d46a90e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:24.032082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1140/2261] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:23 2022] DELETE /identity/v3/users/c2569109fb40431ca4d4cd9e4d46a90e => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:24.036832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:24.037338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:24.037705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:24.068620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:24.070347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:24.142184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1122/2262] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:24.152462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:24.153856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:24.226201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc8764-3fad-4afd-96fd-642ac78d9ce6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:24.230069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:24.230756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:24.231038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:24.231319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:24.243991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:24.245784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:24.258464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1141/2263] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:24.316805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:24.811156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:24.811156 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:24.824966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5c2ee-69ff-4417-be07-fd3f80161b03 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:24.832446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:24.833944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:24.834424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:24.835647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] PATH_INFO: `/v3/projects/c38c2350b3e447eaa0872ac1017fc711` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:24.837028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38c2350b3e447eaa0872ac1017fc711)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:24.839684 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:24.988842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38c2350b3e447eaa0872ac1017fc711', 'request_id': 'req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:24.995522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38c2350b3e447eaa0872ac1017fc711', 'request_id': 'req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.004233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38c2350b3e447eaa0872ac1017fc711', 'request_id': 'req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.095399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] The token cache is being invalidate because project c38c2350b3e447eaa0872ac1017fc711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:25.096158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.096560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.098837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1123/2264] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:24 2022] DELETE /identity/v3/projects/c38c2350b3e447eaa0872ac1017fc711 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:25.102630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:25.116313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc332ec-81aa-4085-baa8-b9fb444ee4a1 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:25.178943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:25.179933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:25.180225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:25.180500 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] PATH_INFO: `/v3/users/c37ffe84922d4b6a874bc46a86988d2a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:25.181936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37ffe84922d4b6a874bc46a86988d2a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:25.184135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:25.346461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37ffe84922d4b6a874bc46a86988d2a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.347181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37ffe84922d4b6a874bc46a86988d2a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.347803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37ffe84922d4b6a874bc46a86988d2a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.360662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37ffe84922d4b6a874bc46a86988d2a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.367941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37ffe84922d4b6a874bc46a86988d2a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:25.432244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:25.472653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1142/2265] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:25 2022] DELETE /identity/v3/users/c37ffe84922d4b6a874bc46a86988d2a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:25.956912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:25.959332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:25.974842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fc3c6-d21d-4ecf-a056-fc616d1c9dac admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:26.042178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:26.043047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:26.043329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:26.043604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] PATH_INFO: `/v3/projects/1be3edd4405e40fcb29d339a5e465081` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:26.044837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be3edd4405e40fcb29d339a5e465081)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:26.050255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:26.170348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:26.184062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be3edd4405e40fcb29d339a5e465081', 'request_id': 'req-ee44cd5a-61ee-4a39-bf65-480a5c5771db'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.192077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be3edd4405e40fcb29d339a5e465081', 'request_id': 'req-ee44cd5a-61ee-4a39-bf65-480a5c5771db'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.198491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be3edd4405e40fcb29d339a5e465081', 'request_id': 'req-ee44cd5a-61ee-4a39-bf65-480a5c5771db'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.266479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] The token cache is being invalidate because project 1be3edd4405e40fcb29d339a5e465081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:26.266689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.267360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.269315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1124/2266] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:25 2022] DELETE /identity/v3/projects/1be3edd4405e40fcb29d339a5e465081 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:26.273228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:26.274847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:26.294922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040ea3-e81b-4690-8734-9bb5115b9124 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:26.360536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:26.361430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:26.361716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:26.361991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] PATH_INFO: `/v3/users/6ba57670e7724a1d80d051cf8c0a0278` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:26.363205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba57670e7724a1d80d051cf8c0a0278)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:26.365218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:26.569574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba57670e7724a1d80d051cf8c0a0278'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.570166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba57670e7724a1d80d051cf8c0a0278'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.570784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba57670e7724a1d80d051cf8c0a0278'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.584492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba57670e7724a1d80d051cf8c0a0278'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.591301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1b569aba-a770-478d-9404-d724c54725a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba57670e7724a1d80d051cf8c0a0278'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:26.676338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1143/2267] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:26 2022] DELETE /identity/v3/users/6ba57670e7724a1d80d051cf8c0a0278 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:27.153933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:27.156142 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:27.176130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44cd5a-61ee-4a39-bf65-480a5c5771db admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:27.251700 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:27.252727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:27.253149 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:27.253433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] PATH_INFO: `/v3/projects/8f25524727b044f8b85466fb5b1d2e3b` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:27.254855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f25524727b044f8b85466fb5b1d2e3b)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:27.256863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:27.388799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f25524727b044f8b85466fb5b1d2e3b', 'request_id': 'req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:27.395110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f25524727b044f8b85466fb5b1d2e3b', 'request_id': 'req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:27.401988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f25524727b044f8b85466fb5b1d2e3b', 'request_id': 'req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:27.483996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] The token cache is being invalidate because project 8f25524727b044f8b85466fb5b1d2e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:27.488253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:27.488253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f28f5d7f-9de5-425f-a6dc-99e60800e9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:27.488253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1125/2268] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:27 2022] DELETE /identity/v3/projects/8f25524727b044f8b85466fb5b1d2e3b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:27.492731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:27.493343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:27.493343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:27.515768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:27.517094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:27.579835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1144/2269] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:27.588768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:27.593680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:27.593680 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:27.611302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:27.612576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:27.623591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1126/2270] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:27.631789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:27.638968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b0d14-e35f-4f89-97f6-d3aff7767767 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:27.644214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:27.644907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:27.645192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:27.645472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:27.646207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:51:27.646522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:27.648156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:27.660460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1145/2271] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:51:27.664863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:27.674840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde5844-ba2d-4574-99b9-a2af461072a8 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:27.679560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:27.680250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:27.680533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:27.680813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:27.681522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:27.683599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:27.805632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1127/2272] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:27 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:27.809904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:27.821194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fee74-dee3-4b07-aabb-52ec2bf83cc7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:27.882785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:27.882785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:27.882785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:27.882785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:27.883285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:27.884451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:27.980299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1146/2273] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:27 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:27.985498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:27.996647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99310ac-7750-4121-9b3e-6296c2530682 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.002097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.004975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.004975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.004975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.004975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.005940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:28.017290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1128/2274] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:28.021219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:28.035597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad7af6-2016-46b4-9821-b67cc21a420b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.040742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6d6f8-e757-45a5-b014-4fec0052dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.041445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d6f8-e757-45a5-b014-4fec0052dbef admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.041730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d6f8-e757-45a5-b014-4fec0052dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.042009 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6d6f8-e757-45a5-b014-4fec0052dbef admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.042744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6d6f8-e757-45a5-b014-4fec0052dbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.044476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6d6f8-e757-45a5-b014-4fec0052dbef admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:28.056494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1147/2275] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:28.060736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:28.071227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc5be0-5fd5-4372-8b2b-52f6b0698c32 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.080831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.081733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.082019 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.082299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] PATH_INFO: `/v3/projects/06cc40ece0a14f908eb79f0b66cddd71/users/3437ef38998d4dfca699448e12607cef/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.098445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cc40ece0a14f908eb79f0b66cddd71, user_id=3437ef38998d4dfca699448e12607cef, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.101185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:28.204764 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1129/2276] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:28 2022] PUT /identity/v3/projects/06cc40ece0a14f908eb79f0b66cddd71/users/3437ef38998d4dfca699448e12607cef/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:28.222860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.223206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.223485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.233406 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:28.254492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] MFA Rules not processed for user `3437ef38998d4dfca699448e12607cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:28.256136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:28.367900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1148/2277] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:28.373616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:28.465459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281bd8f-a930-400b-abbd-ae1472c7f754 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.470875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.476000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.476000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.476000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.476000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.476000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:28.564190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1130/2278] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:28 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:28.565460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:28.578651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:28.588366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a7e9-8ff4-4f20-893b-b85131fc9aa0 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.694294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.695394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.696031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.696570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.697532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.700805 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:28.822086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:28.828484 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1149/2279] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:28 2022] POST /identity/v3/users => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:28.834164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69bd27-bb4b-4e29-81da-bcda99a5f78d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.839951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.840660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.840948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.841229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.841974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.844485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:28.859436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1131/2280] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:28.860904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:28.878385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85dc67-7312-4894-8665-313a3d52dbab admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:28.883580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:28.884546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:28.884831 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:28.885112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] PATH_INFO: `/v3/projects/b95d6d5840114c06a7e37be9b8534e55/users/6f5803d1af9844119bd87f03fc217fad/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:28.915806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95d6d5840114c06a7e37be9b8534e55, user_id=6f5803d1af9844119bd87f03fc217fad, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:28.918618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:29.089740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1150/2281] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:28 2022] PUT /identity/v3/projects/b95d6d5840114c06a7e37be9b8534e55/users/6f5803d1af9844119bd87f03fc217fad/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:29.094576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:29.104686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b150b-6651-47f2-bf7a-9864f311c352 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:29.167197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33ba6e-f4ed-43cf-840f-53bdad4910dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:29.167879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ba6e-f4ed-43cf-840f-53bdad4910dc admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:29.168195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ba6e-f4ed-43cf-840f-53bdad4910dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:29.168474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33ba6e-f4ed-43cf-840f-53bdad4910dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:29.169211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33ba6e-f4ed-43cf-840f-53bdad4910dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:29.170902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33ba6e-f4ed-43cf-840f-53bdad4910dc admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:29.181589 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1132/2282] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:29.185854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:29.196871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130d346-7752-45e7-8d8d-455681388542 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:29.202735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:29.203726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:29.204038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:29.204311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] PATH_INFO: `/v3/projects/b95d6d5840114c06a7e37be9b8534e55/users/6f5803d1af9844119bd87f03fc217fad/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:29.206375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95d6d5840114c06a7e37be9b8534e55, user_id=6f5803d1af9844119bd87f03fc217fad, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:29.209282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:29.221146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1151/2283] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:29 2022] PUT /identity/v3/projects/b95d6d5840114c06a7e37be9b8534e55/users/6f5803d1af9844119bd87f03fc217fad/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:51:29.232536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:29.233024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:29.233224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:29.264895 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] MFA Rules not processed for user `6f5803d1af9844119bd87f03fc217fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:29.266242 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:29.336117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1133/2284] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:29.347380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:29.349130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:29.407604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f55b0-31bc-4d5c-82f2-666de211eb38 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:29.411354 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:29.412041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:29.412346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:29.412627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:29.422075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:29.423516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:29.433183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1152/2285] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:29.481311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:29.482758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:29.495682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2fb48-5d9e-402c-8e86-25e3326fdab3 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:29.500096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97a7f1-ef3f-4c53-afcf-522afe75a218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:29.500807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97a7f1-ef3f-4c53-afcf-522afe75a218 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:29.501086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97a7f1-ef3f-4c53-afcf-522afe75a218 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:29.501369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97a7f1-ef3f-4c53-afcf-522afe75a218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:29.565080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97a7f1-ef3f-4c53-afcf-522afe75a218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:29.566484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97a7f1-ef3f-4c53-afcf-522afe75a218 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:29.576855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1134/2286] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:29.654889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:29.656489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:29.730405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae5323-a5bf-4344-b0aa-7b798a237c24 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:29.736377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:29.737285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:29.737571 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:29.737850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] PATH_INFO: `/v3/users/bc9c979aa8584ab2bd8ee67a6894ad30` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:29.739076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9c979aa8584ab2bd8ee67a6894ad30)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:29.741335 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:29.951902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9c979aa8584ab2bd8ee67a6894ad30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:29.952777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9c979aa8584ab2bd8ee67a6894ad30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:29.953613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9c979aa8584ab2bd8ee67a6894ad30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:29.967303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9c979aa8584ab2bd8ee67a6894ad30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:29.975037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9c979aa8584ab2bd8ee67a6894ad30'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:30.095302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1153/2287] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:29 2022] DELETE /identity/v3/users/bc9c979aa8584ab2bd8ee67a6894ad30 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:30.100694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:30.100991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:30.101460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:30.124875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:30.130893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:30.219793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1135/2288] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:30.226501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:30.228088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:30.301084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607229b-55f6-4795-a766-a58badf1320a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:30.304834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21038062-789c-411f-b7ed-df9c9d1f1556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:30.305543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038062-789c-411f-b7ed-df9c9d1f1556 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:30.305768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038062-789c-411f-b7ed-df9c9d1f1556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:30.306047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038062-789c-411f-b7ed-df9c9d1f1556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:30.316299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21038062-789c-411f-b7ed-df9c9d1f1556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:30.317833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21038062-789c-411f-b7ed-df9c9d1f1556 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:30.329414 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1154/2289] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:30.489490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:30.874827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:30.876729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:30.891632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90401d6d-804a-418a-aaa5-a4b710e90263 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:30.898754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:30.901238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:30.901238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:30.901238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] PATH_INFO: `/v3/projects/88a6c899dab54390bec72cf245479e1f` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:30.901593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a6c899dab54390bec72cf245479e1f)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:30.903525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:30.985136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:31.034186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a6c899dab54390bec72cf245479e1f', 'request_id': 'req-56293e89-f405-4118-bd24-0b9001e673c2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:31.039982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a6c899dab54390bec72cf245479e1f', 'request_id': 'req-56293e89-f405-4118-bd24-0b9001e673c2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:31.047447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a6c899dab54390bec72cf245479e1f', 'request_id': 'req-56293e89-f405-4118-bd24-0b9001e673c2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:31.129038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] The token cache is being invalidate because project 88a6c899dab54390bec72cf245479e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:31.129332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:31.130200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-56293e89-f405-4118-bd24-0b9001e673c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:31.132147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1136/2290] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:30 2022] DELETE /identity/v3/projects/88a6c899dab54390bec72cf245479e1f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:31.138604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.138906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.139174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.160981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:31.162374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:31.225153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1155/2291] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:31.233701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.234122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.234518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.259429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:31.260686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:31.270086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1137/2292] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:31.274576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:31.285691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55690479-6893-4e06-a6f2-11877cf6005c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:31.290372 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:31.291035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.291346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.291596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.292366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:51:31.292679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:31.294290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:31.307307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1156/2293] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:51:31.312121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:31.324865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d242d-1325-4cd1-89c8-25a60f5d8d04 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:31.330373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:31.331054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.331345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.331656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.332369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:31.334311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:31.450396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1138/2294] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:31 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:31.451429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:31.464300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17d069-2a14-4e2d-8857-6f3b88559a88 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:31.524906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:31.525900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.526367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.526655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.527440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:31.529383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:31.628621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1157/2295] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:31 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:31.633573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:31.652241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bb7d3-4280-4a10-8f17-e1baeccc7a07 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:31.660643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:31.663426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.663426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.663426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.663426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:31.664476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:31.679380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1139/2296] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:31.680449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:31.693680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9b7a7-2760-439f-a0b5-d2b56aa230ba admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:31.714537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef9db-a11b-4587-a753-0fab3aa1cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:31.715216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef9db-a11b-4587-a753-0fab3aa1cded admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.715496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef9db-a11b-4587-a753-0fab3aa1cded admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.715768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef9db-a11b-4587-a753-0fab3aa1cded admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.716557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef9db-a11b-4587-a753-0fab3aa1cded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:31.718863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef9db-a11b-4587-a753-0fab3aa1cded admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:31.731975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1158/2297] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:31.735613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:31.746709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef18f-4052-4359-9430-cc09b3b64d03 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:31.753408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:31.754468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.754743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.755003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] PATH_INFO: `/v3/projects/7f0fa74ebf64492fb13b36fb51847104/users/91990e7e05ca4521bd6d583ebbd595ec/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.773376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0fa74ebf64492fb13b36fb51847104, user_id=91990e7e05ca4521bd6d583ebbd595ec, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:31.776325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:31.792102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:31.917354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1140/2298] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:31 2022] PUT /identity/v3/projects/7f0fa74ebf64492fb13b36fb51847104/users/91990e7e05ca4521bd6d583ebbd595ec/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:51:31.932671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1237a-8856-4130-9264-638ceed9719d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:31.932982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1237a-8856-4130-9264-638ceed9719d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:31.933261 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1237a-8856-4130-9264-638ceed9719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:31.965106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-07d1237a-8856-4130-9264-638ceed9719d None None] MFA Rules not processed for user `91990e7e05ca4521bd6d583ebbd595ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:31.966348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-07d1237a-8856-4130-9264-638ceed9719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:32.033840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1159/2299] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:32.149685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:32.151571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:32.213744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b01ba0-10a3-4035-9654-f7a141fa7c86 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:32.217911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bb0dd-89d5-4d7f-9007-f43bf30d9853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:32.218573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb0dd-89d5-4d7f-9007-f43bf30d9853 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:32.218859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb0dd-89d5-4d7f-9007-f43bf30d9853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:32.219136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bb0dd-89d5-4d7f-9007-f43bf30d9853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:32.228134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bb0dd-89d5-4d7f-9007-f43bf30d9853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:32.229804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bb0dd-89d5-4d7f-9007-f43bf30d9853 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:32.241190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1141/2300] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:32.267610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1237a-8856-4130-9264-638ceed9719d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:32.338010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1237a-8856-4130-9264-638ceed9719d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:32.343606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:32.344672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:32.344978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:32.345218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] PATH_INFO: `/v3/users/91990e7e05ca4521bd6d583ebbd595ec` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:32.346473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91990e7e05ca4521bd6d583ebbd595ec)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:32.348447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:32.599882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91990e7e05ca4521bd6d583ebbd595ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:32.600575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91990e7e05ca4521bd6d583ebbd595ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:32.601177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91990e7e05ca4521bd6d583ebbd595ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:32.612770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91990e7e05ca4521bd6d583ebbd595ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:32.620058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91990e7e05ca4521bd6d583ebbd595ec'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:32.713592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1160/2301] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:32 2022] DELETE /identity/v3/users/91990e7e05ca4521bd6d583ebbd595ec => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:32.719138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:32.719683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:32.719683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:32.743167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:32.748452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:32.792021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:32.820676 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1142/2302] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:32.833104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:32.834876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:32.894526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bed07-ef5b-4bf3-960d-1ee6ffe880b3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:32.898319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:32.898998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:32.899285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:32.899573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:32.910529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:32.911814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:32.922810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1161/2303] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:33.283265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:33.399241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:33.400701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:33.413936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c41c-ed71-45ee-90f4-3216ca2e7125 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:33.418594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:33.419463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:33.419741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:33.420047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] PATH_INFO: `/v3/projects/7f0fa74ebf64492fb13b36fb51847104` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:33.421784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0fa74ebf64492fb13b36fb51847104)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:33.423710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:33.558372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0fa74ebf64492fb13b36fb51847104', 'request_id': 'req-77f8083a-ada2-49f4-b778-6cafc48512f3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:33.564604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0fa74ebf64492fb13b36fb51847104', 'request_id': 'req-77f8083a-ada2-49f4-b778-6cafc48512f3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:33.570932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0fa74ebf64492fb13b36fb51847104', 'request_id': 'req-77f8083a-ada2-49f4-b778-6cafc48512f3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:33.660617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] The token cache is being invalidate because project 7f0fa74ebf64492fb13b36fb51847104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:33.660946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:33.661599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:33.663240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1143/2304] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:33 2022] DELETE /identity/v3/projects/7f0fa74ebf64492fb13b36fb51847104 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:34.394033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:34.395542 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:34.454786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:34.460055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aefa0e-cdbb-4d5f-9031-c70a8eb02689 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:34.511677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:34.512289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:34.512597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:34.512873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:34.515586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:34.580120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:34.581833 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839565-b238-485e-a6b3-cee45bbb82bf service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:34.592986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1162/2305] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:34.769120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:34.770728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:34.844520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8083a-ada2-49f4-b778-6cafc48512f3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:34.849246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:34.850097 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:34.850379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:34.850654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] PATH_INFO: `/v3/users/3437ef38998d4dfca699448e12607cef` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:34.851978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3437ef38998d4dfca699448e12607cef)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:34.853926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:35.093401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3437ef38998d4dfca699448e12607cef'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:35.094326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3437ef38998d4dfca699448e12607cef'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:35.096421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3437ef38998d4dfca699448e12607cef'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:35.110330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3437ef38998d4dfca699448e12607cef'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:35.118184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3437ef38998d4dfca699448e12607cef'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:35.213135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1144/2306] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:34 2022] DELETE /identity/v3/users/3437ef38998d4dfca699448e12607cef => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:35.221129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:35.221430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:35.221714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:35.245024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:35.245801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:35.315893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1163/2307] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:35.339417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:35.339417 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:35.397308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cef430-9ad2-47ae-a742-8e8ca25c41d1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:35.400905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:35.401565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:35.407890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:35.407890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:35.416064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:35.417608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:35.429660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1145/2308] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:35.438776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:35.734786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:36.069265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:36.071026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:36.107418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af8520-0355-4e52-953a-c15c8472a1b3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:36.113901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:36.114776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:36.115062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:36.115340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] PATH_INFO: `/v3/projects/06cc40ece0a14f908eb79f0b66cddd71` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:36.116899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06cc40ece0a14f908eb79f0b66cddd71)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:36.118820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:36.241094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06cc40ece0a14f908eb79f0b66cddd71', 'request_id': 'req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.247255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06cc40ece0a14f908eb79f0b66cddd71', 'request_id': 'req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.294127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06cc40ece0a14f908eb79f0b66cddd71', 'request_id': 'req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.307276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] The token cache is being invalidate because project 06cc40ece0a14f908eb79f0b66cddd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:36.307561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.308223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.309827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1164/2309] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:36 2022] DELETE /identity/v3/projects/06cc40ece0a14f908eb79f0b66cddd71 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:36.313905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:36.323547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15457430-7420-47c6-87aa-d0be22cf966f service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:36.350268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:36.381175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:36.382053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:36.382336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:36.382616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] PATH_INFO: `/v3/users/6f5803d1af9844119bd87f03fc217fad` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:36.383807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5803d1af9844119bd87f03fc217fad)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:36.385791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:36.596236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:36.638274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5803d1af9844119bd87f03fc217fad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.638933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5803d1af9844119bd87f03fc217fad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.639534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5803d1af9844119bd87f03fc217fad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.651887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5803d1af9844119bd87f03fc217fad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.659609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-835e51b3-0112-43b5-ba18-c00650d73aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5803d1af9844119bd87f03fc217fad'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:36.821268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1146/2310] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:51:36 2022] DELETE /identity/v3/users/6f5803d1af9844119bd87f03fc217fad => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:37.152114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:37.317932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:37.320650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:37.336475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f50e0-302d-4b88-a4cc-d74ef2dacb4b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:37.395584 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:37.396509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:37.396788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:37.397063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] PATH_INFO: `/v3/projects/b95d6d5840114c06a7e37be9b8534e55` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:37.398230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95d6d5840114c06a7e37be9b8534e55)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:37.400206 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:37.504398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95d6d5840114c06a7e37be9b8534e55', 'request_id': 'req-63bdad7f-bd02-4421-82ef-2fc2dc128b79'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:37.510315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95d6d5840114c06a7e37be9b8534e55', 'request_id': 'req-63bdad7f-bd02-4421-82ef-2fc2dc128b79'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:37.584086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95d6d5840114c06a7e37be9b8534e55', 'request_id': 'req-63bdad7f-bd02-4421-82ef-2fc2dc128b79'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:37.595718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] The token cache is being invalidate because project b95d6d5840114c06a7e37be9b8534e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:51:37.596031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:37.596656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-63bdad7f-bd02-4421-82ef-2fc2dc128b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:51:37.598192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1165/2311] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:51:37 2022] DELETE /identity/v3/projects/b95d6d5840114c06a7e37be9b8534e55 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:37.603182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:37.603480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:37.603766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:37.623772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:37.625187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:37.686227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1147/2312] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:37.694813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:37.695102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:37.695420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:37.712171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:37.717599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:37.718832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:37.727509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1166/2313] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:37.731757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:37.742315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05f855-9790-49b4-bbf3-7bedf0b66430 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:37.746918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:37.747576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:37.747850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:37.748151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:37.748881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:51:37.749188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:37.751006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:37.762645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1148/2314] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:51:37.767477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:37.777461 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ba013-c168-41f2-82fb-5a4fc5d35c5b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:37.782492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:37.783254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:37.783540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:37.783818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:37.784541 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:37.786424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:37.894830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1167/2315] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:51:37 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:37.898980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:37.910349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519701c-ae57-4d11-a11e-d42dd6be9e10 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:37.970833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:37.971517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:37.971803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:37.972110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:37.972819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:37.974777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:38.050276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1149/2316] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:51:37 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:51:38.054879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:38.066398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd71c79-8eda-4bab-a73c-52f7308636d5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:38.071787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:38.072491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:38.072778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:38.073640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:38.073854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:38.075475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:38.086737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1168/2317] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:51:38.091064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:38.105637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e981-97f2-4b92-ae52-066f1e116f0f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:38.107567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc54b0-ac23-4e3a-a865-bff727c17a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:38.108278 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc54b0-ac23-4e3a-a865-bff727c17a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:38.108560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc54b0-ac23-4e3a-a865-bff727c17a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:38.108835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc54b0-ac23-4e3a-a865-bff727c17a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:38.109564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc54b0-ac23-4e3a-a865-bff727c17a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:38.111702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc54b0-ac23-4e3a-a865-bff727c17a65 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:38.123552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1150/2318] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:51:38.131295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:38.141487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64059cad-7212-40c0-9280-ed19e9b39c6f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:38.146821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:38.147765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:38.148165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:38.151345 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] PATH_INFO: `/v3/projects/f4bb70b6d91c409fb57a14b7e26acbba/users/7ac7d10b2b1b427faa1a24803bf18e21/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:38.163651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:38.174390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4bb70b6d91c409fb57a14b7e26acbba, user_id=7ac7d10b2b1b427faa1a24803bf18e21, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:38.174390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:38.263342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1169/2319] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:51:38 2022] PUT /identity/v3/projects/f4bb70b6d91c409fb57a14b7e26acbba/users/7ac7d10b2b1b427faa1a24803bf18e21/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:51:38.275978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2e23-d23d-4e7d-8168-ff7f81896cba None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:38.275978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2e23-d23d-4e7d-8168-ff7f81896cba None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:38.275978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2e23-d23d-4e7d-8168-ff7f81896cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:38.317472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-636e2e23-d23d-4e7d-8168-ff7f81896cba None None] MFA Rules not processed for user `7ac7d10b2b1b427faa1a24803bf18e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:38.319058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-636e2e23-d23d-4e7d-8168-ff7f81896cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:38.409155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1151/2320] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:38.419890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:38.421924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:38.487519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d7621-4859-46f4-b750-96c4f478223d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:38.491747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfc67-1c29-4bd9-9b55-9eb92ed8f852 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:38.492447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfc67-1c29-4bd9-9b55-9eb92ed8f852 service glance] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:38.492733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfc67-1c29-4bd9-9b55-9eb92ed8f852 service glance] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:38.493003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfc67-1c29-4bd9-9b55-9eb92ed8f852 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:38.504624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfc67-1c29-4bd9-9b55-9eb92ed8f852 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:38.506083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfc67-1c29-4bd9-9b55-9eb92ed8f852 service glance] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:38.515794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1170/2321] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:51:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:51:38.780848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:39.591997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:40.507363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:41.260627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:41.911718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:42.614645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:43.065968 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:43.329452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:44.186258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:44.511674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:44.786254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:44.940901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:45.014731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:45.412802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:45.532728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:45.814373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:45.882996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:46.282617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:46.357271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:46.562993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:46.666445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:47.117737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:47.203611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:47.900191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:48.205885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:49.130923 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:49.835654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:50.072363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:50.072654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:50.072979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:50.094075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] MFA Rules not processed for user `93c4b63d65304186ba0ba06a6a31f3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:50.095470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:50.161184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1152/2322] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:51:50.218386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:51.338216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:51.711444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:52.191190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:52.453694 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:52.534665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:52.618859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:52.619454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:52.619987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:52.641526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:51:52.643910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:52.709626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1171/2323] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:51:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:51:52.754649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:51:52.756160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:51:52.774561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:52.830105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdd58d-1693-4f80-8fe8-604d6ede629a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:51:52.835277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:51:52.836140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:51:52.836376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:51:52.836653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:51:52.846794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:51:52.848438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:51:52.859871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1153/2324] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:51:53.025905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:53.500371 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:53.662323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:53.699190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:54.163600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:54.218011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:54.466077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:54.830507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:55.036051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:55.266177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:55.516983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:56.162032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:56.328069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:56.475244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:56.583895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:56.698836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:56.863862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=82,keystone:INSERT=2,keystone:DELETE=16 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:57.428925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:57.774147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:57.903871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.054466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.183950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.275697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.494303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.591758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.717535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.809258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:58.871857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.055783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.178705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.208097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.499980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.571894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.716786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:51:59.774133 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.094091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.137994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.402233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.434795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.554799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:00.583570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:01.103437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:01.192191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:02.003222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:02.191572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:03.086735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:03.231358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:03.356209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:03.357903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:03.392293 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:03.511091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae038197-2ee1-4c71-b77b-a982714f8760 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:03.520402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:03.522040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:03.522581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:03.523112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] PATH_INFO: `/v3/users/fe37cc9571714a83ad8d3a0f0d36b6b8` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:03.525208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe37cc9571714a83ad8d3a0f0d36b6b8)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:03.527709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:03.748311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe37cc9571714a83ad8d3a0f0d36b6b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:03.749427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe37cc9571714a83ad8d3a0f0d36b6b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:03.750428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe37cc9571714a83ad8d3a0f0d36b6b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:03.800042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe37cc9571714a83ad8d3a0f0d36b6b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:03.812989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe37cc9571714a83ad8d3a0f0d36b6b8'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:03.914753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1172/2325] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:03 2022] DELETE /identity/v3/users/fe37cc9571714a83ad8d3a0f0d36b6b8 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:04.233163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:04.279414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a311d14-2345-4c6a-b261-f7f64ced4bb1 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:04.372073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:04.372940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:04.373222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:04.373494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] PATH_INFO: `/v3/projects/8c4c8ef622d34e0cb1cba21a04901e43` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:04.374706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c4c8ef622d34e0cb1cba21a04901e43)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:04.376658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:04.515504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c4c8ef622d34e0cb1cba21a04901e43', 'request_id': 'req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:04.524883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c4c8ef622d34e0cb1cba21a04901e43', 'request_id': 'req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:04.534310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c4c8ef622d34e0cb1cba21a04901e43', 'request_id': 'req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:04.629392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] The token cache is being invalidate because project 8c4c8ef622d34e0cb1cba21a04901e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:04.629877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:04.630531 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:04.632158 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1154/2326] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:04 2022] DELETE /identity/v3/projects/8c4c8ef622d34e0cb1cba21a04901e43 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:04.636385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:04.638546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:04.655303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4977c5-de87-46b0-8cb2-12116a950b78 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:04.741850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:04.743615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:04.744150 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:04.744698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] PATH_INFO: `/v3/users/24dad38fbec546b3a1945f253b94400d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:04.747218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24dad38fbec546b3a1945f253b94400d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:04.749602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:05.002201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:05.017331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24dad38fbec546b3a1945f253b94400d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.017331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24dad38fbec546b3a1945f253b94400d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.017331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24dad38fbec546b3a1945f253b94400d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.051973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24dad38fbec546b3a1945f253b94400d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.058607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0e49d229-fdeb-47da-9952-ff844ec65d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24dad38fbec546b3a1945f253b94400d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.152068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1173/2327] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:04 2022] DELETE /identity/v3/users/24dad38fbec546b3a1945f253b94400d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:05.447533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:05.449347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:05.466658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f5e9-f69d-42ad-9a36-ba0ade1d1656 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:05.518331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:05.568668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:05.570005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:05.570520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:05.572162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] PATH_INFO: `/v3/projects/447a72e4c49e4576a14a96fea545cc7c` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:05.574117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=447a72e4c49e4576a14a96fea545cc7c)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:05.577317 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:05.716785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447a72e4c49e4576a14a96fea545cc7c', 'request_id': 'req-06a6b4bc-2feb-42f6-88b8-0732932a2127'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.727022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447a72e4c49e4576a14a96fea545cc7c', 'request_id': 'req-06a6b4bc-2feb-42f6-88b8-0732932a2127'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.734456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447a72e4c49e4576a14a96fea545cc7c', 'request_id': 'req-06a6b4bc-2feb-42f6-88b8-0732932a2127'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.833062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] The token cache is being invalidate because project 447a72e4c49e4576a14a96fea545cc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:05.833571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.834164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-06a6b4bc-2feb-42f6-88b8-0732932a2127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:05.836172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1155/2328] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:05 2022] DELETE /identity/v3/projects/447a72e4c49e4576a14a96fea545cc7c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:05.844376 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:05.844839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:05.845000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:05.870435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:05.871732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:06.004166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1174/2329] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:06.017827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.018356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.019464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.069378 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:06.070968 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:06.092271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1156/2330] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:06.096777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:06.116088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7416a1-7fb9-42b9-8d1e-5cbad2c618d4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:06.144882 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:06.145678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.146026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.148271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.156795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:52:06.156795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:06.157426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:06.179526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1175/2331] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:52:06.188780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:06.201864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931d0e1-1207-4517-bcd6-b4ed4b52a454 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:06.215604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:06.216505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.216915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.217859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.220139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:06.238236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:06.349033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1157/2332] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:06 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:06.353610 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:06.382895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510b35f-b71a-4ddf-977d-e0bc1e2d7615 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:06.505659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:06.506835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.506835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.507034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.507810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:06.510351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:06.638623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1176/2333] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:06 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:06.639540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:06.651107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cafdd9-f0d4-4000-892f-35a9a07ec1d2 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:06.659721 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:06.660723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.661219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.661713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.662634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:06.664482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:06.681648 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1158/2334] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:52:06.695450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:06.710381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eecac0-f2ff-407d-95dd-1c541079145f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:06.723489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aae9b8-eac3-4e50-90c6-b31bad36845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:06.726368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae9b8-eac3-4e50-90c6-b31bad36845d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.726767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae9b8-eac3-4e50-90c6-b31bad36845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.727085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aae9b8-eac3-4e50-90c6-b31bad36845d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.728200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aae9b8-eac3-4e50-90c6-b31bad36845d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:06.730230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aae9b8-eac3-4e50-90c6-b31bad36845d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:06.752187 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1177/2335] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:06.753066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:06.764247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd28847-e97f-47f2-99be-ad44752ed396 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:06.773679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:06.775590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.776401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.777047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] PATH_INFO: `/v3/projects/e1afcdc1487e42278cc843a79ed8d6a7/users/2864027141dc4d02a1304283fcf37e16/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.802328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1afcdc1487e42278cc843a79ed8d6a7, user_id=2864027141dc4d02a1304283fcf37e16, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:06.807834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:06.894759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1159/2336] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:06 2022] PUT /identity/v3/projects/e1afcdc1487e42278cc843a79ed8d6a7/users/2864027141dc4d02a1304283fcf37e16/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:06.906320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:06.909035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:06.909560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:06.945419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] MFA Rules not processed for user `2864027141dc4d02a1304283fcf37e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:06.946744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:06.952583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:07.036016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1178/2337] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:07.048992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:07.050923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:07.155101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463bbb-9616-4f90-8e43-e7876f1ed2f3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:07.159495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e7da5-ab1b-4ef7-98c3-98b15f3743bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:07.160210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7da5-ab1b-4ef7-98c3-98b15f3743bd service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:07.160579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7da5-ab1b-4ef7-98c3-98b15f3743bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:07.160921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e7da5-ab1b-4ef7-98c3-98b15f3743bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:07.172096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e7da5-ab1b-4ef7-98c3-98b15f3743bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:07.174718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e7da5-ab1b-4ef7-98c3-98b15f3743bd service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:07.188069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1160/2338] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:07.430696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:07.432275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:07.534328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d69ed9-c624-49c7-81e7-0ad2b35ab071 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:07.539530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:07.540475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:07.540759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:07.541038 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] PATH_INFO: `/v3/users/7ac7d10b2b1b427faa1a24803bf18e21` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:07.542283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac7d10b2b1b427faa1a24803bf18e21)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:07.544702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:07.811938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac7d10b2b1b427faa1a24803bf18e21'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:07.812707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac7d10b2b1b427faa1a24803bf18e21'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:07.813408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac7d10b2b1b427faa1a24803bf18e21'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:07.841890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac7d10b2b1b427faa1a24803bf18e21'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:07.852251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac7d10b2b1b427faa1a24803bf18e21'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:07.987606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1179/2339] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:07 2022] DELETE /identity/v3/users/7ac7d10b2b1b427faa1a24803bf18e21 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:07.993324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:07.994178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:07.994795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:08.012678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:08.023822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:08.026088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:08.133649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1161/2340] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:08.150154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:08.151659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:08.194132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:08.264655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631ed92-b4ec-4b24-af88-32d985dfa492 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:08.270908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c661a7-2a75-4d38-83ad-53766df72a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:08.271708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c661a7-2a75-4d38-83ad-53766df72a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:08.272134 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c661a7-2a75-4d38-83ad-53766df72a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:08.272423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c661a7-2a75-4d38-83ad-53766df72a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:08.283902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c661a7-2a75-4d38-83ad-53766df72a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:08.285866 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c661a7-2a75-4d38-83ad-53766df72a89 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:08.299079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1180/2341] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:09.014722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:09.022257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:09.031416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334690b2-413c-4a4d-b14a-de4329e4a9f2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:09.037095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:09.038107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:09.038395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:09.039208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] PATH_INFO: `/v3/projects/f4bb70b6d91c409fb57a14b7e26acbba` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:09.045609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4bb70b6d91c409fb57a14b7e26acbba)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:09.045609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:09.180050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4bb70b6d91c409fb57a14b7e26acbba', 'request_id': 'req-286b1593-8dbf-42d0-8104-f983a52f3277'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:09.186561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4bb70b6d91c409fb57a14b7e26acbba', 'request_id': 'req-286b1593-8dbf-42d0-8104-f983a52f3277'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:09.194029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4bb70b6d91c409fb57a14b7e26acbba', 'request_id': 'req-286b1593-8dbf-42d0-8104-f983a52f3277'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:09.288147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] The token cache is being invalidate because project f4bb70b6d91c409fb57a14b7e26acbba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:09.289124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:09.289848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-286b1593-8dbf-42d0-8104-f983a52f3277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:09.292351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1162/2342] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:09 2022] DELETE /identity/v3/projects/f4bb70b6d91c409fb57a14b7e26acbba => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:09.297218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:09.297763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:09.297907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:09.321903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:09.323262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:09.430564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1181/2343] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:09.432568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:09.432878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:09.433160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:09.488371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:09.490287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:09.510108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1163/2344] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:09.511481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:09.524279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0ac57-4997-4aa2-b5dd-ef0b0601277d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:09.530170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:09.530971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:09.531472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:09.531959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:09.532846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:52:09.533956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:09.535962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:09.552085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1182/2345] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:52:09.555111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:09.573730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f4306-750f-4bd4-a72a-437c12039a81 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:09.592858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:09.593670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:09.593905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:09.594196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:09.594931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:09.601312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:09.816512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1164/2346] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:09 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:09.820443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:09.833619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d853-c7c3-46c9-89ac-69280b0f686b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:09.926148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:09.927179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:09.927619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:09.928175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:09.929104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:09.931311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:10.035997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1183/2347] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:09 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:10.040220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:10.052726 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50318612-cd67-4dac-bde5-5ed79faf79c2 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:10.082264 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:10.082975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:10.083802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:10.084114 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:10.084941 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:10.086578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:10.106061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:10.117128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1165/2348] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:10.119969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea902b-c8e9-47e6-93c6-db7a7643c224 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:10.125937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173719a-ec48-4827-aeed-fc940ff9072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:10.126667 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173719a-ec48-4827-aeed-fc940ff9072e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:10.127566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173719a-ec48-4827-aeed-fc940ff9072e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:10.127851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173719a-ec48-4827-aeed-fc940ff9072e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:10.128765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173719a-ec48-4827-aeed-fc940ff9072e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:10.130704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173719a-ec48-4827-aeed-fc940ff9072e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:10.154855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:10.165631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79275-4269-441e-8d2a-fb7a82ccda6b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:10.166242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1184/2349] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:10.171045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:10.172225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:10.176239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:10.176239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] PATH_INFO: `/v3/projects/94b5814e2c8c4d3a9be2ac2397a4416d/users/64dfc5be341c412ba8494b6e74a4bc36/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:10.197679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b5814e2c8c4d3a9be2ac2397a4416d, user_id=64dfc5be341c412ba8494b6e74a4bc36, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:10.200900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:10.313716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1166/2350] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:10 2022] PUT /identity/v3/projects/94b5814e2c8c4d3a9be2ac2397a4416d/users/64dfc5be341c412ba8494b6e74a4bc36/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:10.327944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:10.327944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:10.327944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:10.367856 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] MFA Rules not processed for user `64dfc5be341c412ba8494b6e74a4bc36`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:10.369960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:10.413675 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:10.484817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1185/2351] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:10.489462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:10.532282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:10.599761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81c262-1122-4932-ae92-43035872480a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:10.609242 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:10.610861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:10.612179 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:10.616106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:10.616106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:10.617740 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:10.740328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1167/2352] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:10 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:10.741876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:10.757588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204435f-7132-4596-b8df-d57f67ab7f15 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:10.863871 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:10.865002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:10.866185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:10.867239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:10.869563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:10.874027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:10.983970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1186/2353] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:10 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:52:10.986849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:10.999028 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550f057-283f-48ac-b57a-32d7b221c063 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:11.007399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:11.007774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:11.007774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:11.008119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:11.008860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:11.011251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:11.026595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1168/2354] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:11.048112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:11.067794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a81129-4f01-4356-b59e-01975a2cdb69 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:11.074221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26580c54-080b-40b0-b8e0-94ae29b9209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:11.074904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26580c54-080b-40b0-b8e0-94ae29b9209b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:11.075186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26580c54-080b-40b0-b8e0-94ae29b9209b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:11.075486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26580c54-080b-40b0-b8e0-94ae29b9209b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:11.076260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26580c54-080b-40b0-b8e0-94ae29b9209b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:11.077946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26580c54-080b-40b0-b8e0-94ae29b9209b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:11.092298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1187/2355] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:11.097213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:11.109774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bc8a3-ee34-40b2-a5fa-931a253bd9f6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:11.117671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:11.118593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:11.118961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:11.119339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] PATH_INFO: `/v3/projects/6bbace71073445ba928beaff581b7135/users/de882de1046247e794523b4a04af6b26/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:11.138259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbace71073445ba928beaff581b7135, user_id=de882de1046247e794523b4a04af6b26, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:11.141568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:11.256562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1169/2356] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:11 2022] PUT /identity/v3/projects/6bbace71073445ba928beaff581b7135/users/de882de1046247e794523b4a04af6b26/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:11.331512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:11.331512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:11.331512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:11.429920 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] MFA Rules not processed for user `de882de1046247e794523b4a04af6b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:11.434837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:11.563957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1188/2357] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:11.568412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:11.681499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbef25d-70c5-4f03-8476-6ddaa493cb96 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:11.696307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:11.698585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:11.699225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:11.699887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:11.700852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:11.703027 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:11.819280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1170/2358] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:11 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:11.822739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:11.838580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b63eb-ce01-4599-97db-6211db9698b7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:11.894669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:12.013186 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:12.014392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.015073 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.015720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:12.017006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:12.021524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:12.135411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1189/2359] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:11 2022] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:12.135522 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:12.144894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68816b-1135-4c44-aa17-d8170febd66d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:12.168867 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:12.169571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.169863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.170151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:12.170903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:12.172578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:12.197166 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1171/2360] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:12.197349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:12.209619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2af18-62a4-4b73-93db-f2bf5e5e8665 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:12.215178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:12.216215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.216602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.216953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] PATH_INFO: `/v3/projects/d7c98034c8c44abca22596441040f8d6/users/ee32edadeced4c2b9a38db1a8d5605cb/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:12.236925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c98034c8c44abca22596441040f8d6, user_id=ee32edadeced4c2b9a38db1a8d5605cb, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:12.240043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:12.351911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1190/2361] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:12 2022] PUT /identity/v3/projects/d7c98034c8c44abca22596441040f8d6/users/ee32edadeced4c2b9a38db1a8d5605cb/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:52:12.367542 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:12.387650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4281-018c-4556-a081-e28612b629d9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:12.493699 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:12.507601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299ac15-8559-4b84-94a8-0847c4eb54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:12.508147 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299ac15-8559-4b84-94a8-0847c4eb54fe admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.508902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299ac15-8559-4b84-94a8-0847c4eb54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.509286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299ac15-8559-4b84-94a8-0847c4eb54fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:12.510673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299ac15-8559-4b84-94a8-0847c4eb54fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:12.512549 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299ac15-8559-4b84-94a8-0847c4eb54fe admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:12.529743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1172/2362] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:12.534353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:12.554427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae79a0-9447-4115-ad33-a20861146568 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:12.573258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:12.574389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.574511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.574762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] PATH_INFO: `/v3/projects/d7c98034c8c44abca22596441040f8d6/users/ee32edadeced4c2b9a38db1a8d5605cb/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:12.578941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c98034c8c44abca22596441040f8d6, user_id=ee32edadeced4c2b9a38db1a8d5605cb, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:12.582063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:12.602824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1191/2363] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:12 2022] PUT /identity/v3/projects/d7c98034c8c44abca22596441040f8d6/users/ee32edadeced4c2b9a38db1a8d5605cb/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:12.621956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.622322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.622572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:12.745034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] MFA Rules not processed for user `ee32edadeced4c2b9a38db1a8d5605cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:12.750539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:12.837101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1173/2364] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:12.846868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:12.852978 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:12.942343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24181d8-9ae2-46ce-b04e-13a4f3339055 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:12.946733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:12.948313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:12.948313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:12.948567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:13.036251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:13.043265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:13.056207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1192/2365] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:15.448512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:15.458656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834403f-a1f4-4396-b8ce-128ab8d613ab None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:15.462385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673658b-cef6-4a4e-9f1f-742acff67a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:15.463032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673658b-cef6-4a4e-9f1f-742acff67a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:15.463311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673658b-cef6-4a4e-9f1f-742acff67a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:15.463581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673658b-cef6-4a4e-9f1f-742acff67a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:15.532365 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673658b-cef6-4a4e-9f1f-742acff67a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:15.534705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673658b-cef6-4a4e-9f1f-742acff67a9c service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:15.545192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1174/2366] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:15.788057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:15.789653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:15.840101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:15.873725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d199293-d80e-43b8-9d39-dd6c452def09 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:15.883714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:15.885615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:15.886632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:15.886777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] PATH_INFO: `/v3/users/2864027141dc4d02a1304283fcf37e16` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:15.889896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2864027141dc4d02a1304283fcf37e16)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:15.894026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:16.199299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2864027141dc4d02a1304283fcf37e16'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:16.200244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2864027141dc4d02a1304283fcf37e16'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:16.200950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2864027141dc4d02a1304283fcf37e16'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:16.217549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2864027141dc4d02a1304283fcf37e16'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:16.225951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2864027141dc4d02a1304283fcf37e16'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:16.292989 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1193/2367] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:15 2022] DELETE /identity/v3/users/2864027141dc4d02a1304283fcf37e16 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:16.298215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:16.298683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:16.299022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:16.320428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:16.321804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:16.394274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1175/2368] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:16.405474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:16.407332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:16.497070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2f095-3558-4a10-8a30-26b838cab64a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:16.501088 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:16.501983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:16.502534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:16.503154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:16.514530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:16.516440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:16.532289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1194/2369] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:17.120794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:17.120794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:17.140286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270551cd-3c19-40a1-b1ce-3ecf91ef06dc None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:17.154165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:17.159339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:17.159760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:17.160337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] PATH_INFO: `/v3/projects/e1afcdc1487e42278cc843a79ed8d6a7` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:17.161720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1afcdc1487e42278cc843a79ed8d6a7)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:17.163875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:17.185986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:17.317102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:17.318737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:17.375987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9bb00-29fa-43a8-913c-9a86aff4a291 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:17.394138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:17.399385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1afcdc1487e42278cc843a79ed8d6a7', 'request_id': 'req-da5c1d1b-a17e-41a0-a77a-913720fd1f49'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:17.408348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1afcdc1487e42278cc843a79ed8d6a7', 'request_id': 'req-da5c1d1b-a17e-41a0-a77a-913720fd1f49'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:17.416516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1afcdc1487e42278cc843a79ed8d6a7', 'request_id': 'req-da5c1d1b-a17e-41a0-a77a-913720fd1f49'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:17.428346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:17.429027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:17.431791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:17.431791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:17.431791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:17.509132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:17.509448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] The token cache is being invalidate because project e1afcdc1487e42278cc843a79ed8d6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:17.509766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:17.510432 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-da5c1d1b-a17e-41a0-a77a-913720fd1f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:17.511127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:17.528521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1176/2370] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:17 2022] DELETE /identity/v3/projects/e1afcdc1487e42278cc843a79ed8d6a7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:17.543659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1195/2371] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:19.940036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:19.940659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:19.940659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:19.961930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:19.963185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:20.026917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1177/2372] 10.222.0.45 () {58 vars in 967 bytes} [Mon Jul 25 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:20.041271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:20.042754 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:20.113969 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3a510-c901-4fa6-a627-d63f4d4c00b1 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:20.119108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c386f1-4d76-4f6b-a13f-1af0b7b92574 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:20.119808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c386f1-4d76-4f6b-a13f-1af0b7b92574 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:20.120121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c386f1-4d76-4f6b-a13f-1af0b7b92574 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:20.120401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c386f1-4d76-4f6b-a13f-1af0b7b92574 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:20.128905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c386f1-4d76-4f6b-a13f-1af0b7b92574 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:20.130487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c386f1-4d76-4f6b-a13f-1af0b7b92574 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:20.138802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1196/2373] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:52:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:52:22.196568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:22.197999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:22.266260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2e650-6280-4cdc-920a-51cc5d8e01d5 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:22.272404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:22.273288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:22.273645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:22.273928 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] PATH_INFO: `/v3/users/64dfc5be341c412ba8494b6e74a4bc36` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:22.275162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dfc5be341c412ba8494b6e74a4bc36)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:22.277216 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:22.445275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:22.451069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dfc5be341c412ba8494b6e74a4bc36'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:22.451614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dfc5be341c412ba8494b6e74a4bc36'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:22.452239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dfc5be341c412ba8494b6e74a4bc36'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:22.465268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dfc5be341c412ba8494b6e74a4bc36'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:22.472530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dfc5be341c412ba8494b6e74a4bc36'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:22.549585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1178/2374] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:22 2022] DELETE /identity/v3/users/64dfc5be341c412ba8494b6e74a4bc36 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:22.554066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:22.554568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:22.554663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:22.574348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:22.575718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:22.629182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:22.638135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1197/2375] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:22.648653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:22.650428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:22.718196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce54f1b-6803-428d-b6f5-735494e375b3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:22.722523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900bf11-eb9e-4a19-a537-3f56ea49a0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:22.723321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bf11-eb9e-4a19-a537-3f56ea49a0fd service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:22.723613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bf11-eb9e-4a19-a537-3f56ea49a0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:22.723890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900bf11-eb9e-4a19-a537-3f56ea49a0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:22.733942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900bf11-eb9e-4a19-a537-3f56ea49a0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:22.735948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900bf11-eb9e-4a19-a537-3f56ea49a0fd service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:22.747022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1179/2376] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:23.231715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:23.233356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:23.249056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc1df9-5f3d-4f92-bca8-a168b96b5bb5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:23.254975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:23.257208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:23.258139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:23.258441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] PATH_INFO: `/v3/projects/94b5814e2c8c4d3a9be2ac2397a4416d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:23.264246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b5814e2c8c4d3a9be2ac2397a4416d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:23.264246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:23.338371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb66d-eda0-409e-8d1b-463e2dc004f8 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:23.338921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb66d-eda0-409e-8d1b-463e2dc004f8 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:23.338921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb66d-eda0-409e-8d1b-463e2dc004f8 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:23.340345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1180/2377] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 12:52:23.368111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:23.368434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:23.368722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:23.391610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] MFA Rules not processed for user `d90a6d60fe644ab5a5c781b6348dfef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:23.391610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:23.431222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b5814e2c8c4d3a9be2ac2397a4416d', 'request_id': 'req-ed17f25c-60e2-48c7-a171-9db3a02df0e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.436936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b5814e2c8c4d3a9be2ac2397a4416d', 'request_id': 'req-ed17f25c-60e2-48c7-a171-9db3a02df0e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.461127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1181/2378] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:23.474933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:23.476311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:23.497402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a4a57-d4be-45ad-9b77-ee0d526f8a28 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:23.514381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b5814e2c8c4d3a9be2ac2397a4416d', 'request_id': 'req-ed17f25c-60e2-48c7-a171-9db3a02df0e1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.528762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] The token cache is being invalidate because project 94b5814e2c8c4d3a9be2ac2397a4416d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:23.529230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.530056 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.532313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1198/2379] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:23 2022] DELETE /identity/v3/projects/94b5814e2c8c4d3a9be2ac2397a4416d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:23.533413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:23.534959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:23.545724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:23.555635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:23.556333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:23.556622 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:23.556902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:23.559350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:23.574414 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:23.576103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:23.587689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1182/2380] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:23.588730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:23.590150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:23.607642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f25c-60e2-48c7-a171-9db3a02df0e1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:23.613651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:23.614644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:23.615078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:23.615757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] PATH_INFO: `/v3/users/5ec07b8bbecc45319086d517d9cca4f7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:23.617106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec07b8bbecc45319086d517d9cca4f7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:23.619115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:23.661830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38621211-f94d-4e34-b3f8-e6dca8bbee74 service placement] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:23.666325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:23.667200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:23.667482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:23.667759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] PATH_INFO: `/v3/users/de882de1046247e794523b4a04af6b26` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:23.668984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de882de1046247e794523b4a04af6b26)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:23.670905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:23.850365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec07b8bbecc45319086d517d9cca4f7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.851044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec07b8bbecc45319086d517d9cca4f7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.851816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec07b8bbecc45319086d517d9cca4f7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.866090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec07b8bbecc45319086d517d9cca4f7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.866910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de882de1046247e794523b4a04af6b26'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.867634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de882de1046247e794523b4a04af6b26'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.868415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de882de1046247e794523b4a04af6b26'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.873705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec07b8bbecc45319086d517d9cca4f7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.881320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de882de1046247e794523b4a04af6b26'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.888468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de882de1046247e794523b4a04af6b26'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:23.957736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:23.962230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1199/2381] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:23 2022] DELETE /identity/v3/users/5ec07b8bbecc45319086d517d9cca4f7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:24.041903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1183/2382] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:23 2022] DELETE /identity/v3/users/de882de1046247e794523b4a04af6b26 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:24.325580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:24.327089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:24.404971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e935ef0-19d9-4c40-ae10-4923c0ec6f73 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:24.466226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:24.467050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.467333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.467609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] PATH_INFO: `/v3/projects/0f9bb7dfd78c4c5886f1db45a886b3ff` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.468853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9bb7dfd78c4c5886f1db45a886b3ff)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:24.471650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:24.504099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:24.505566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:24.522565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4d317-8377-4869-99eb-3af2cdbf229b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:24.528127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:24.529242 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.529523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.529797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] PATH_INFO: `/v3/projects/6bbace71073445ba928beaff581b7135` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.531024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbace71073445ba928beaff581b7135)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:24.533781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:24.595677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9bb7dfd78c4c5886f1db45a886b3ff', 'request_id': 'req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.601587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9bb7dfd78c4c5886f1db45a886b3ff', 'request_id': 'req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.682395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbace71073445ba928beaff581b7135', 'request_id': 'req-cdb8736f-7966-43cf-9a5b-7794530972f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.688454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbace71073445ba928beaff581b7135', 'request_id': 'req-cdb8736f-7966-43cf-9a5b-7794530972f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.690616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:24.695024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9bb7dfd78c4c5886f1db45a886b3ff', 'request_id': 'req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.695614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbace71073445ba928beaff581b7135', 'request_id': 'req-cdb8736f-7966-43cf-9a5b-7794530972f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.706952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] The token cache is being invalidate because project 0f9bb7dfd78c4c5886f1db45a886b3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:24.707264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.707955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-23a5f88d-5f7e-4d8f-9661-e8bae30c30c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.709498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1200/2383] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:24 2022] DELETE /identity/v3/projects/0f9bb7dfd78c4c5886f1db45a886b3ff => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:24.714616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cfe76-625e-4ed7-9d71-75832d8c96d9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.714899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cfe76-625e-4ed7-9d71-75832d8c96d9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.715200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cfe76-625e-4ed7-9d71-75832d8c96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.736154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-983cfe76-625e-4ed7-9d71-75832d8c96d9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:24.737473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-983cfe76-625e-4ed7-9d71-75832d8c96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:24.796198 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1201/2384] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:24.804565 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.804955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.805305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.805515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] The token cache is being invalidate because project 6bbace71073445ba928beaff581b7135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:24.805811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.806460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:24.808059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1184/2385] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:24 2022] DELETE /identity/v3/projects/6bbace71073445ba928beaff581b7135 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:52:24.811872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:24.813643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:24.825724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:24.826733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8736f-7966-43cf-9a5b-7794530972f7 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:24.826925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:24.831682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:24.832592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.832878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.833157 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] PATH_INFO: `/v3/users/ee32edadeced4c2b9a38db1a8d5605cb` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.834450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee32edadeced4c2b9a38db1a8d5605cb)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:24.841155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1202/2386] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:24.841354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:24.844152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:24.854387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c041938-b7aa-4d87-abdf-efda71dc7849 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:24.859106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:24.859768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.860090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.861072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.861813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:52:24.862122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:24.863718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:24.875725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1203/2387] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:52:24.880489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:24.890326 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1aae6-3b76-46ef-bc5f-289bf06f1e52 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:24.893307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:24.896975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:24.913032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:24.913032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:24.913032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:24.913032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:24.913032 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.009285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1204/2388] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:24 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:52:25.012850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:25.026108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee32edadeced4c2b9a38db1a8d5605cb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.027077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee32edadeced4c2b9a38db1a8d5605cb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.028053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee32edadeced4c2b9a38db1a8d5605cb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.040570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee32edadeced4c2b9a38db1a8d5605cb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.047392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee32edadeced4c2b9a38db1a8d5605cb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.083199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15041c7-e2c3-4d74-aac3-037f521a1fd8 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:25.088028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:25.088702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.088987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.089267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.089961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:25.091889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.143325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1185/2389] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:24 2022] DELETE /identity/v3/users/ee32edadeced4c2b9a38db1a8d5605cb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:52:25.212049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1205/2390] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:25 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:52:25.216327 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:25.217885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:25.291373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3098505-e75d-4ed6-ad16-a08c79b7cf8f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:25.296102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:25.296789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.297066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.297342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.298080 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:25.299725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.310479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1186/2391] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:25.315080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:25.325419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8680-7348-4e19-bb07-24f87b9eabf6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:25.330714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348475ed-8078-4b7a-91d3-3ba4e02d147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:25.331446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348475ed-8078-4b7a-91d3-3ba4e02d147b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.331721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348475ed-8078-4b7a-91d3-3ba4e02d147b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.332254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348475ed-8078-4b7a-91d3-3ba4e02d147b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.332995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348475ed-8078-4b7a-91d3-3ba4e02d147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:25.334595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348475ed-8078-4b7a-91d3-3ba4e02d147b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.345251 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1206/2392] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:25.349602 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:25.361031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18fda-7027-4ecb-acea-704ee586696b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:25.367008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:25.367910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.368219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.368495 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] PATH_INFO: `/v3/projects/521b6817d267468b9b42076bb2f529d9/users/3c078a141f7b4e959319842d2f3fa017/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.384990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=521b6817d267468b9b42076bb2f529d9, user_id=3c078a141f7b4e959319842d2f3fa017, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:25.387829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.473035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1187/2393] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:25 2022] PUT /identity/v3/projects/521b6817d267468b9b42076bb2f529d9/users/3c078a141f7b4e959319842d2f3fa017/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:25.484040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.484331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.484608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.515199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] MFA Rules not processed for user `3c078a141f7b4e959319842d2f3fa017`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:25.516552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:25.581046 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1207/2394] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:25.592294 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:25.594640 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:25.599980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:25.602903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:25.646980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:25.670268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0baaaa-2232-45d6-bee4-9204d6423b22 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:25.674098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90ab31-356f-45d0-af0d-cbfbc1a17000 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:25.674759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90ab31-356f-45d0-af0d-cbfbc1a17000 service glance] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.675040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90ab31-356f-45d0-af0d-cbfbc1a17000 service glance] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.675363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90ab31-356f-45d0-af0d-cbfbc1a17000 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.688920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90ab31-356f-45d0-af0d-cbfbc1a17000 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:25.688920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90ab31-356f-45d0-af0d-cbfbc1a17000 service glance] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.693297 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:25.694942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2d7c8-7d3e-4ba5-925c-46930bb12f17 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:25.698884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1188/2395] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:25.701821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:25.702790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.703140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.703511 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] PATH_INFO: `/v3/projects/d7c98034c8c44abca22596441040f8d6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.705658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c98034c8c44abca22596441040f8d6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:25.707592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:25.831600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c98034c8c44abca22596441040f8d6', 'request_id': 'req-6be7ff66-1bfb-4158-acbb-559d6388a0d3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.837383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c98034c8c44abca22596441040f8d6', 'request_id': 'req-6be7ff66-1bfb-4158-acbb-559d6388a0d3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.907953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c98034c8c44abca22596441040f8d6', 'request_id': 'req-6be7ff66-1bfb-4158-acbb-559d6388a0d3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.921501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] The token cache is being invalidate because project d7c98034c8c44abca22596441040f8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:25.921958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.923053 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-6be7ff66-1bfb-4158-acbb-559d6388a0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:25.925127 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1208/2396] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:25 2022] DELETE /identity/v3/projects/d7c98034c8c44abca22596441040f8d6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:52:25.930273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:25.930567 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:25.930850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:25.950826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:25.952148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:26.025058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1189/2397] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:26.035273 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.035564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.035861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.055842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:26.057089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:26.065505 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1209/2398] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:26.069892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.080743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d6e9d-6b0c-407e-b24d-beed2b6751ff None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.085653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.086336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.086621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.086900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.087627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:52:26.087957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.089659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:26.102815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1190/2399] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:52:26.107400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.117392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c028c25-28c1-40e0-9a23-4dafb6ed5159 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.122086 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.122741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.123024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.123299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.124025 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.126536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:26.237291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1210/2400] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:26.241832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.252374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2a346-b440-4a17-9029-157bf440c794 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.313173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.314555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.315634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.315955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.316677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.318629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:26.434359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1191/2401] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:26 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:52:26.439133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.451390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a46be-3483-496e-a45b-9a473810f6d9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.456648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.457322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.457618 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.462507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.462507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.462507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:26.475835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1211/2402] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:26.477356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.489931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdac68-fc71-4143-bd54-8ac832aea901 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.495371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064cd3d-33c0-4960-9753-6a7af712561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.496023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064cd3d-33c0-4960-9753-6a7af712561d admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.496323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064cd3d-33c0-4960-9753-6a7af712561d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.496697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064cd3d-33c0-4960-9753-6a7af712561d admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.497435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064cd3d-33c0-4960-9753-6a7af712561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.499036 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064cd3d-33c0-4960-9753-6a7af712561d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:26.520822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1192/2403] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:26.522267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.533601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dc401-49cb-490b-b618-ab633ce413e0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.539956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.539956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.540349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.540349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] PATH_INFO: `/v3/projects/fa4729614fa745b8ab651f3d95fdac0e/users/f9b607737ea34b6c890aab44b4cf210d/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.686237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4729614fa745b8ab651f3d95fdac0e, user_id=f9b607737ea34b6c890aab44b4cf210d, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.689137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:26.768426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1212/2404] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:26 2022] PUT /identity/v3/projects/fa4729614fa745b8ab651f3d95fdac0e/users/f9b607737ea34b6c890aab44b4cf210d/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:26.778786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.779263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.779388 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.810078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] MFA Rules not processed for user `f9b607737ea34b6c890aab44b4cf210d`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:26.811297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:26.842281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:26.877310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1193/2405] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:26.881765 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:26.914728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:26.943413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b104a9-47d8-4b56-9ea9-21f5e42fd46c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:26.948144 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:26.948807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:26.949116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:26.949391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:26.950093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:26.952000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.037314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1213/2406] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:26 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:27.041329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.052275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f6b58-df35-442b-808a-b5b671e42685 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.113310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.113994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.114276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.114581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.115579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.117590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.252427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1194/2407] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:27 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:27.256367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.267208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b4078-8e26-49cd-8fd2-b3f8b70d1650 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.271808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.272507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.272823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.273097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.273846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.275494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.288842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1214/2408] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:27.292866 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.303657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f552e-f2b0-4d9f-8b7a-13a981a78640 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.308362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea860c1-ff9c-4d15-9bd5-aa08a6d050af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.309030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea860c1-ff9c-4d15-9bd5-aa08a6d050af admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.309315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea860c1-ff9c-4d15-9bd5-aa08a6d050af admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.309587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea860c1-ff9c-4d15-9bd5-aa08a6d050af admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.310316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea860c1-ff9c-4d15-9bd5-aa08a6d050af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.311910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea860c1-ff9c-4d15-9bd5-aa08a6d050af admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.322724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1195/2409] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:27.326921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.337064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6b47-dd99-4a68-aae2-f222baa35350 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.341743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.342604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.342879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.343148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] PATH_INFO: `/v3/projects/847a2a724c594f7cb7a769e2f38e8131/users/c2b9a38e96de4279b7ae0ded903bf2c9/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.361855 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=847a2a724c594f7cb7a769e2f38e8131, user_id=c2b9a38e96de4279b7ae0ded903bf2c9, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.364680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.457299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1215/2410] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:27 2022] PUT /identity/v3/projects/847a2a724c594f7cb7a769e2f38e8131/users/c2b9a38e96de4279b7ae0ded903bf2c9/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:27.467562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.467872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.468195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.498775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] MFA Rules not processed for user `c2b9a38e96de4279b7ae0ded903bf2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:27.500038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:27.567091 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1196/2411] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:52:27.571804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.638367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37b2a4-4def-4945-b6a9-84737d82d0ce admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.643138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.643795 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.644258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.644402 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.645066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.646951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.729212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1216/2412] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:27 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:27.733329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.747235 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07e091-922c-4e47-bcc9-3979dcaea273 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.794653 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:27.814996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.815713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.816037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.816322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.817056 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.819008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.931233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1197/2413] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:27 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:27.935460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.946189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b6e0b-53f5-4f70-8a37-7f5555ed1834 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.950711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.951440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.951722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.952037 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:27.952799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:27.955016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:27.965690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1217/2414] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:27.970252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:27.980539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426440-a59e-47ee-803e-626dc9f73ab6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:27.985037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:27.986398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:27.986677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:27.986951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] PATH_INFO: `/v3/projects/b93dc07e6821450bb3624ade4a08768c/users/09395f80aa9243b69b5cf8f76112a51c/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:28.002467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93dc07e6821450bb3624ade4a08768c, user_id=09395f80aa9243b69b5cf8f76112a51c, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:28.005175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:28.402009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1198/2415] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:27 2022] PUT /identity/v3/projects/b93dc07e6821450bb3624ade4a08768c/users/09395f80aa9243b69b5cf8f76112a51c/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:28.427133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:28.439517 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54ce4-783f-4b25-aacc-e19f1a113bad admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:28.495226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:28.502854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942ef98-43fa-41c2-8a15-c63553181725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:28.503545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942ef98-43fa-41c2-8a15-c63553181725 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:28.503826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942ef98-43fa-41c2-8a15-c63553181725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:28.504131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942ef98-43fa-41c2-8a15-c63553181725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:28.504847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942ef98-43fa-41c2-8a15-c63553181725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:28.506489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942ef98-43fa-41c2-8a15-c63553181725 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:28.516588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1218/2416] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:28.521239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:28.533798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea0bc-f021-42d1-be91-18488a0690ab admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:28.538629 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:28.539513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:28.539794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:28.540100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] PATH_INFO: `/v3/projects/b93dc07e6821450bb3624ade4a08768c/users/09395f80aa9243b69b5cf8f76112a51c/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:28.542115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93dc07e6821450bb3624ade4a08768c, user_id=09395f80aa9243b69b5cf8f76112a51c, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:28.545323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:28.557845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1199/2417] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:28 2022] PUT /identity/v3/projects/b93dc07e6821450bb3624ade4a08768c/users/09395f80aa9243b69b5cf8f76112a51c/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:28.569363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392069-3b11-4341-9d40-617eff093c81 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:28.569654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392069-3b11-4341-9d40-617eff093c81 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:28.569928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392069-3b11-4341-9d40-617eff093c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:28.597152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-99392069-3b11-4341-9d40-617eff093c81 None None] MFA Rules not processed for user `09395f80aa9243b69b5cf8f76112a51c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:28.598342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99392069-3b11-4341-9d40-617eff093c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:28.671582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1219/2418] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:28.688177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:28.690410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:28.754353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635440a4-b5ab-4c3a-b300-7bc24c4837c5 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:28.758856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:28.759678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:28.759993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:28.760273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:28.828736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:28.830252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:28.839807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1200/2419] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:30.853393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99392069-3b11-4341-9d40-617eff093c81 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:30.854800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-99392069-3b11-4341-9d40-617eff093c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:30.868373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99392069-3b11-4341-9d40-617eff093c81 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:30.877683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:30.883718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:30.883718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:30.883718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:30.938995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:30.940559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:30.950578 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1220/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:32.320271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:32.329975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e7197-c19a-4f2f-9599-f45cdb2187d9 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:32.334076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc91cb-3a51-4bf8-a4cc-f2428ad585bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:32.334744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc91cb-3a51-4bf8-a4cc-f2428ad585bc service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:32.335034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc91cb-3a51-4bf8-a4cc-f2428ad585bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:32.335314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc91cb-3a51-4bf8-a4cc-f2428ad585bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:32.345213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc91cb-3a51-4bf8-a4cc-f2428ad585bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:32.346706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc91cb-3a51-4bf8-a4cc-f2428ad585bc service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:32.356518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1201/2421] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:37.080430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:37.149483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8660a-9bf5-4c89-8a2a-1e138d8aa92e service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:37.154082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:37.154949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:37.155231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:37.155526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] PATH_INFO: `/v3/users/f9b607737ea34b6c890aab44b4cf210d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:37.156752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b607737ea34b6c890aab44b4cf210d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:37.158779 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:37.174622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:37.397663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b607737ea34b6c890aab44b4cf210d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:37.398801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b607737ea34b6c890aab44b4cf210d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:37.399264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b607737ea34b6c890aab44b4cf210d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:37.412894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b607737ea34b6c890aab44b4cf210d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:37.419741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b607737ea34b6c890aab44b4cf210d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:37.502998 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1221/2422] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:37 2022] DELETE /identity/v3/users/f9b607737ea34b6c890aab44b4cf210d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:37.509057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:37.513434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:37.513434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:37.528696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:37.529902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:37.563523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:37.590758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1202/2423] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:37.600970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:37.602392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:37.661262 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71744f50-5c03-4d80-acc0-6883fb339077 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:37.664884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:37.665530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:37.665812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:37.666129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:37.676539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:37.678007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:37.689170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1222/2424] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:38.083548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:38.085110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:38.098139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf134b-db95-4cbc-b625-8f59940809ef None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:38.102879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:38.106309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:38.106309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:38.106309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] PATH_INFO: `/v3/projects/fa4729614fa745b8ab651f3d95fdac0e` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:38.106309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4729614fa745b8ab651f3d95fdac0e)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:38.107565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:38.237825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4729614fa745b8ab651f3d95fdac0e', 'request_id': 'req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.244087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4729614fa745b8ab651f3d95fdac0e', 'request_id': 'req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.250500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4729614fa745b8ab651f3d95fdac0e', 'request_id': 'req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.326324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] The token cache is being invalidate because project fa4729614fa745b8ab651f3d95fdac0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:38.326610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.327228 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.328858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1203/2425] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:38 2022] DELETE /identity/v3/projects/fa4729614fa745b8ab651f3d95fdac0e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:38.333116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:38.343094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caaa694-b448-42c8-ae44-775401cbf458 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:38.406821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:38.407690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:38.408000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:38.409091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] PATH_INFO: `/v3/users/c2b9a38e96de4279b7ae0ded903bf2c9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:38.410451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b9a38e96de4279b7ae0ded903bf2c9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:38.412381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:38.557739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:38.563467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b9a38e96de4279b7ae0ded903bf2c9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.564142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b9a38e96de4279b7ae0ded903bf2c9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.564750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b9a38e96de4279b7ae0ded903bf2c9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.577991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b9a38e96de4279b7ae0ded903bf2c9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.586464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b9a38e96de4279b7ae0ded903bf2c9'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:38.698995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1223/2426] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:38 2022] DELETE /identity/v3/users/c2b9a38e96de4279b7ae0ded903bf2c9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:39.127652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:39.129212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:39.146808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87dd0e-bb7d-44e6-b8d7-ff3d8096e12d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:39.216792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:39.217973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:39.218331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:39.218669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] PATH_INFO: `/v3/projects/847a2a724c594f7cb7a769e2f38e8131` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:39.220120 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847a2a724c594f7cb7a769e2f38e8131)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:39.222989 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:39.354939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847a2a724c594f7cb7a769e2f38e8131', 'request_id': 'req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.360547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847a2a724c594f7cb7a769e2f38e8131', 'request_id': 'req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.362296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:39.368366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847a2a724c594f7cb7a769e2f38e8131', 'request_id': 'req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.433953 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] The token cache is being invalidate because project 847a2a724c594f7cb7a769e2f38e8131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:39.434243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.434874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.436457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1204/2427] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:39 2022] DELETE /identity/v3/projects/847a2a724c594f7cb7a769e2f38e8131 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:39.441296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:39.442863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:39.455723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0dc49-cb17-4b2d-89b5-12cd6d7e8c76 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:39.519542 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:39.520471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:39.520755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:39.521034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] PATH_INFO: `/v3/users/09395f80aa9243b69b5cf8f76112a51c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:39.522294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09395f80aa9243b69b5cf8f76112a51c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:39.524245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:39.717995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09395f80aa9243b69b5cf8f76112a51c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.718739 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09395f80aa9243b69b5cf8f76112a51c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.719350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09395f80aa9243b69b5cf8f76112a51c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.735043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09395f80aa9243b69b5cf8f76112a51c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.746469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-232110e4-a7ad-43e1-a0d9-3704383a2566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09395f80aa9243b69b5cf8f76112a51c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:39.863028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1224/2428] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:52:39 2022] DELETE /identity/v3/users/09395f80aa9243b69b5cf8f76112a51c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:40.329334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:40.331608 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:40.349122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ebabe-f5ea-432e-a5f3-47ae54b2e50a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:40.423741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:40.424815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:40.425148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:40.425438 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] PATH_INFO: `/v3/projects/b93dc07e6821450bb3624ade4a08768c` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:40.426946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93dc07e6821450bb3624ade4a08768c)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:40.430201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:40.545203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93dc07e6821450bb3624ade4a08768c', 'request_id': 'req-31e806e5-2f0b-4956-8309-2303f95598ff'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:40.551021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93dc07e6821450bb3624ade4a08768c', 'request_id': 'req-31e806e5-2f0b-4956-8309-2303f95598ff'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:40.558742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93dc07e6821450bb3624ade4a08768c', 'request_id': 'req-31e806e5-2f0b-4956-8309-2303f95598ff'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:40.628753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] The token cache is being invalidate because project b93dc07e6821450bb3624ade4a08768c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:52:40.629073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:40.629731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-31e806e5-2f0b-4956-8309-2303f95598ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:52:40.631272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1205/2429] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:52:40 2022] DELETE /identity/v3/projects/b93dc07e6821450bb3624ade4a08768c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:40.636485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:40.637005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:40.637283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:40.658772 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:40.666604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:40.693848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:40.728815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1225/2430] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:40.741913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:40.742196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:40.747001 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:40.782055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:40.785115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:40.795873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1206/2431] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:40.801033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:40.821540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5eedc-4dce-41b6-86de-940fe798fb32 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:40.826340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:40.827012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:40.827299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:40.827573 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:40.828538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:52:40.829325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:40.832423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:40.845519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1226/2432] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:52:40.851316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:40.861192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4de71b-cbb6-4c5d-8c48-18291582e079 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:40.867060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:40.867798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:40.868188 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:40.868552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:40.869338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:40.871477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:40.991958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1207/2433] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:52:40 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:40.993160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:41.004724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54487f-b9ac-4dae-ae75-5e6232171626 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:41.066301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:41.066980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:41.067260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:41.067534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:41.068288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:41.070233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:41.171945 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1227/2434] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:52:40 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:52:41.177152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:41.189369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64593a-c335-48fe-866c-6a290a3876ea admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:41.194834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:41.199528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:41.199528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:41.199528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:41.199528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:41.199528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:41.214729 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1208/2435] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:41.216188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:41.226875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976b54c-4d7d-4cf5-9543-5f76fd3db63f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:41.231666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f914245-f110-4b7c-a24e-3d7db2277762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:41.232379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914245-f110-4b7c-a24e-3d7db2277762 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:41.232655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914245-f110-4b7c-a24e-3d7db2277762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:41.232925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f914245-f110-4b7c-a24e-3d7db2277762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:41.233649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914245-f110-4b7c-a24e-3d7db2277762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:41.235232 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f914245-f110-4b7c-a24e-3d7db2277762 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:41.247226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1228/2436] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:52:41.251389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:41.261574 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b402-3c85-4bea-97dd-08dc12622b4d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:41.266933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:41.268146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:41.268478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:41.268932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] PATH_INFO: `/v3/projects/041a64fbe053446e8b4036280ac39b5b/users/d857420316884066a1b6229e4747c1f7/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:41.288554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041a64fbe053446e8b4036280ac39b5b, user_id=d857420316884066a1b6229e4747c1f7, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:41.291257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:41.368477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1209/2437] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:52:41 2022] PUT /identity/v3/projects/041a64fbe053446e8b4036280ac39b5b/users/d857420316884066a1b6229e4747c1f7/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:52:41.380013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:41.380304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:41.383093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:41.414809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] MFA Rules not processed for user `d857420316884066a1b6229e4747c1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:52:41.416324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:41.487714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1229/2438] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:52:41.500039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:41.502161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:41.518853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:41.566878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174b8d-1083-4b92-8662-319e03e86cd5 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:41.570731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:41.571375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:41.571658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:41.572002 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:41.581047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:41.582471 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:41.591464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1210/2439] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:42.146365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:52:42.147804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:42.181359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:42.226720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb5e60-529d-4cbd-86c9-117cc2c47a37 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:52:42.231889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:52:42.232597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:52:42.232971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:52:42.233139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:52:42.234961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:52:42.247729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:52:42.249352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7262-b267-44ff-8909-ea17d769242f service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:52:42.260165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1230/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:52:51.647270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=20 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:52:52.589692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=18 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:00.604290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:00.605824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:00.672795 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5147-6204-4147-b170-ce6ee7d748fd service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:00.677523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:00.678400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:00.678709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:00.678981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] PATH_INFO: `/v3/users/3c078a141f7b4e959319842d2f3fa017` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:00.680910 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c078a141f7b4e959319842d2f3fa017)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:00.683256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:00.913099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c078a141f7b4e959319842d2f3fa017'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:00.913099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c078a141f7b4e959319842d2f3fa017'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:00.913493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c078a141f7b4e959319842d2f3fa017'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:00.926756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c078a141f7b4e959319842d2f3fa017'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:00.934486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c078a141f7b4e959319842d2f3fa017'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:01.012745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1211/2441] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:53:00 2022] DELETE /identity/v3/users/3c078a141f7b4e959319842d2f3fa017 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:53:01.017246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:01.017760 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:01.017942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:01.036612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:01.037824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:01.097425 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1231/2442] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:01.107470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:01.108928 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:01.166204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b5918-c9bf-4c52-8aea-8f241edfe9cd admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:01.170032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec833a21-6cdc-4075-862a-5c3d1319cd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:01.170681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec833a21-6cdc-4075-862a-5c3d1319cd54 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:01.170966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec833a21-6cdc-4075-862a-5c3d1319cd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:01.171244 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec833a21-6cdc-4075-862a-5c3d1319cd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:01.180272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec833a21-6cdc-4075-862a-5c3d1319cd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:01.182488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec833a21-6cdc-4075-862a-5c3d1319cd54 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:01.191932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1212/2443] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:53:01.624677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:01.626342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:01.640665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4af4d-835f-4a3b-b0c5-bc6e5d4b672c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:01.646143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:01.651205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:01.651205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:01.651205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] PATH_INFO: `/v3/projects/521b6817d267468b9b42076bb2f529d9` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:01.651205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=521b6817d267468b9b42076bb2f529d9)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:01.651205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:01.801641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '521b6817d267468b9b42076bb2f529d9', 'request_id': 'req-dcf1ae3f-c349-497f-a384-4ba589e90070'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:01.807684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '521b6817d267468b9b42076bb2f529d9', 'request_id': 'req-dcf1ae3f-c349-497f-a384-4ba589e90070'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:01.876074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '521b6817d267468b9b42076bb2f529d9', 'request_id': 'req-dcf1ae3f-c349-497f-a384-4ba589e90070'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:01.887673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] The token cache is being invalidate because project 521b6817d267468b9b42076bb2f529d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:53:01.887984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:01.888602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-dcf1ae3f-c349-497f-a384-4ba589e90070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:01.890454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1232/2444] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:53:01 2022] DELETE /identity/v3/projects/521b6817d267468b9b42076bb2f529d9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:53:01.895533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:01.896065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:01.896167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:01.917618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:01.918837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:01.937316 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:01.987493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1213/2445] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:01.996182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:01.996476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:01.996810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.017050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:02.018274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:02.027586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1233/2446] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:02.032100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.043592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb836d8-0e95-4491-bef4-18f303b27689 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.052345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.053376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.053673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.059627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.059627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:53:02.059627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.059627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.071461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1214/2447] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:53:02.076639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.086646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb166c0-4434-4b4e-b611-86b70b074f2d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.093058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.093721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.094005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.094280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.094973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.096899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.209137 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1234/2448] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:53:02 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:53:02.213873 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.224054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44af0e6-ede9-418e-ba37-fd9a0994b317 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.280632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.281308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.281597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.281880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.282623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.284842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.350209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1215/2449] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:53:02 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:53:02.354621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.366661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd2de-b2f2-487c-ac86-4727641f949e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.372343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.374480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.374480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.374480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.374755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.376312 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.387769 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1235/2450] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:53:02.391979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.404257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923f1a7-8be7-45a6-815c-2600988973c9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.409481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5502ce0-cfdd-4a22-9910-6b05feddfe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.410141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5502ce0-cfdd-4a22-9910-6b05feddfe98 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.410423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5502ce0-cfdd-4a22-9910-6b05feddfe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.410696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5502ce0-cfdd-4a22-9910-6b05feddfe98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.411450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5502ce0-cfdd-4a22-9910-6b05feddfe98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.413285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5502ce0-cfdd-4a22-9910-6b05feddfe98 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.425527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1216/2451] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:53:02.429827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.440052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f609e-1307-4651-94e7-0cbee2b1b610 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.444678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.445549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.445834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.446149 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] PATH_INFO: `/v3/projects/d89f3be96fb943a6a5742c1fa08a52cc/users/4f5721c52d6a4e2a8ae8e2c6ce9041f4/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.461216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89f3be96fb943a6a5742c1fa08a52cc, user_id=4f5721c52d6a4e2a8ae8e2c6ce9041f4, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.464480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.530113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1236/2452] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:53:02 2022] PUT /identity/v3/projects/d89f3be96fb943a6a5742c1fa08a52cc/users/4f5721c52d6a4e2a8ae8e2c6ce9041f4/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:53:02.535128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4899b-562e-42b4-aa70-77497ae17333 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.535399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4899b-562e-42b4-aa70-77497ae17333 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.535702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4899b-562e-42b4-aa70-77497ae17333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.555077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-19b4899b-562e-42b4-aa70-77497ae17333 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:02.556436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-19b4899b-562e-42b4-aa70-77497ae17333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:02.614651 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1217/2453] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:02.624632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:02.626321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:02.648079 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:02.683382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bac24-c129-4b6e-9678-7c80e95b3c5c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:02.687020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:02.687662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:02.688071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:02.688255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:02.698306 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:02.699773 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:02.709503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1237/2454] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:53:03.951681 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6587a-a9fe-4e60-8d93-466c70db2d66 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:03.952322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6587a-a9fe-4e60-8d93-466c70db2d66 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:03.952322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6587a-a9fe-4e60-8d93-466c70db2d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:03.983437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-21a6587a-a9fe-4e60-8d93-466c70db2d66 None None] MFA Rules not processed for user `4f5721c52d6a4e2a8ae8e2c6ce9041f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:03.984714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-21a6587a-a9fe-4e60-8d93-466c70db2d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:04.003141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:04.059673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1218/2455] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:04.070706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:04.072163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:04.135560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423e076-20c2-4811-af2b-198ac126ce31 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:04.139041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb03f07-8611-421a-9c46-e124a3362873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:04.139673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb03f07-8611-421a-9c46-e124a3362873 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:04.139977 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb03f07-8611-421a-9c46-e124a3362873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:04.140255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb03f07-8611-421a-9c46-e124a3362873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:04.148418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb03f07-8611-421a-9c46-e124a3362873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:04.149872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb03f07-8611-421a-9c46-e124a3362873 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:04.158699 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1238/2456] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:53:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:53:05.903325 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:05.903868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:05.904045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:05.922728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] MFA Rules not processed for user `4f5721c52d6a4e2a8ae8e2c6ce9041f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:05.923957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:05.930840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1219/2457] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:12.808958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4316b-882c-492f-a857-f105b9b954ab None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:12.809468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4316b-882c-492f-a857-f105b9b954ab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:12.809566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4316b-882c-492f-a857-f105b9b954ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:12.828842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ece4316b-882c-492f-a857-f105b9b954ab None None] MFA Rules not processed for user `64a4e1770f3d4a79a7ae379184f094c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:12.830029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ece4316b-882c-492f-a857-f105b9b954ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:12.883821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1239/2458] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:15.917330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=22 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:22.876888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=68 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:27.846307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:27.847877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:27.862604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95b0a3-11d4-4041-8aa7-fbe2f75e2327 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:27.867124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:27.868038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:27.868328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:27.868929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] PATH_INFO: `/v3/users/d857420316884066a1b6229e4747c1f7` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:27.873805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d857420316884066a1b6229e4747c1f7)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:27.876101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:28.086521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd857420316884066a1b6229e4747c1f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:28.087260 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd857420316884066a1b6229e4747c1f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:28.087890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd857420316884066a1b6229e4747c1f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:28.103752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd857420316884066a1b6229e4747c1f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:28.111277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd857420316884066a1b6229e4747c1f7'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:28.213250 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1220/2459] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:53:27 2022] DELETE /identity/v3/users/d857420316884066a1b6229e4747c1f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:53:28.219138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:28.219138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:28.219138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:28.244852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:28.247288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:28.312892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1240/2460] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:28.322297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:28.325341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:28.400503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136efa-0f15-4d6c-b589-de2dddbbd699 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:28.400503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23eb8f-0559-4fd1-84ac-2cc8fda94ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:28.400503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23eb8f-0559-4fd1-84ac-2cc8fda94ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:28.400503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23eb8f-0559-4fd1-84ac-2cc8fda94ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:28.400876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23eb8f-0559-4fd1-84ac-2cc8fda94ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:28.407525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23eb8f-0559-4fd1-84ac-2cc8fda94ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:28.409107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23eb8f-0559-4fd1-84ac-2cc8fda94ab2 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:28.418865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1221/2461] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:53:28.857266 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:28.859821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:28.883299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f47b4-169d-46a3-a2b3-d2ea20569628 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:28.898731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:28.899637 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:28.899943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:28.900215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] PATH_INFO: `/v3/projects/041a64fbe053446e8b4036280ac39b5b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:28.901441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=041a64fbe053446e8b4036280ac39b5b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:28.903953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:29.060147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041a64fbe053446e8b4036280ac39b5b', 'request_id': 'req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:29.065194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041a64fbe053446e8b4036280ac39b5b', 'request_id': 'req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:29.151721 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041a64fbe053446e8b4036280ac39b5b', 'request_id': 'req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:29.163872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] The token cache is being invalidate because project 041a64fbe053446e8b4036280ac39b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:53:29.164195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:29.164851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f25d1c6-aae6-4f63-93b3-e0db393cd42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:53:29.166550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1241/2462] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:53:28 2022] DELETE /identity/v3/projects/041a64fbe053446e8b4036280ac39b5b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:53:38.414617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:39.160428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:53:41.548736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:41.549305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:41.549305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:41.568621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] MFA Rules not processed for user `93c4b63d65304186ba0ba06a6a31f3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:41.569808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:41.631978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1222/2463] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:50.624196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417553-c20d-4619-a3d3-0432954018ef None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:50.624722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417553-c20d-4619-a3d3-0432954018ef None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:50.624722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69417553-c20d-4619-a3d3-0432954018ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:50.644893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-69417553-c20d-4619-a3d3-0432954018ef None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:50.646095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-69417553-c20d-4619-a3d3-0432954018ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:50.707121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1242/2464] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:50.731573 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:50.733039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:50.807601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595159e-048b-4d2d-ab48-a3eff1f83b32 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:50.813915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:50.814724 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:50.815105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:50.815384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:50.824364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:50.826502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:50.836871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1223/2465] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:53:55.901561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b88c9-f2b4-48f8-ba5a-7a12f9c91d16 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:55.902081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b88c9-f2b4-48f8-ba5a-7a12f9c91d16 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:55.902081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b88c9-f2b4-48f8-ba5a-7a12f9c91d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:55.922407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-050b88c9-f2b4-48f8-ba5a-7a12f9c91d16 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:53:55.923611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-050b88c9-f2b4-48f8-ba5a-7a12f9c91d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:53:55.931617 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1243/2466] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:53:55.958993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:53:55.970489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881b926-c197-4e52-9b0e-36183d0be235 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:53:55.975825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:53:55.976487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:53:55.976766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:53:55.977039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:53:55.985750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:53:55.987315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:53:55.996879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1224/2467] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:00.593548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02212-8420-4ccd-bb20-14a3a43ddf2b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:00.594094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02212-8420-4ccd-bb20-14a3a43ddf2b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:00.594094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed02212-8420-4ccd-bb20-14a3a43ddf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:00.613611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0ed02212-8420-4ccd-bb20-14a3a43ddf2b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:00.616497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0ed02212-8420-4ccd-bb20-14a3a43ddf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:00.623084 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1244/2468] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:54:00.650916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:00.662628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b8430-02d3-4438-a4cd-0b668b92884d service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:00.668100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:00.669390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:00.669668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:00.669942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:00.678074 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:00.679668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:00.693373 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1225/2469] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:04.416140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1733-5f8e-42a5-b62e-a7dfdbd75a1e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:04.416671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1733-5f8e-42a5-b62e-a7dfdbd75a1e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:04.416671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1733-5f8e-42a5-b62e-a7dfdbd75a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:04.436761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-b2cb1733-5f8e-42a5-b62e-a7dfdbd75a1e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:04.437960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b2cb1733-5f8e-42a5-b62e-a7dfdbd75a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:04.445812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1245/2470] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:54:04.469102 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:04.470642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:04.485789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3961d7-56dd-4257-8015-a41be3887e8a service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:04.491182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:04.491808 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:04.492127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:04.492398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:04.501403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:04.502966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:04.512309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1226/2471] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:08.645436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4835fc-19a2-44b7-a644-e110a644ba69 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:08.645973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4835fc-19a2-44b7-a644-e110a644ba69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:08.646078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4835fc-19a2-44b7-a644-e110a644ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:08.665123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ed4835fc-19a2-44b7-a644-e110a644ba69 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:08.666307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ed4835fc-19a2-44b7-a644-e110a644ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:08.674587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1246/2472] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:54:08.706666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:08.715832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=78 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:08.721870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80500fd-db36-49b4-9d6e-e669dd943eb6 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:08.727359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:08.731339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:08.731339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:08.731339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:08.736894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:08.738672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:08.748912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1227/2473] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:12.869539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b79389-26c3-413f-a295-8c4b6d587fbe None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:12.870058 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b79389-26c3-413f-a295-8c4b6d587fbe None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:12.870156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b79389-26c3-413f-a295-8c4b6d587fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:12.890252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c8b79389-26c3-413f-a295-8c4b6d587fbe None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:12.891462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c8b79389-26c3-413f-a295-8c4b6d587fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:12.899216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1247/2474] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:54:12.921284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:12.932289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f16c07-8da3-4017-9edc-ddbfe84fb169 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:12.937992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:12.938620 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:12.938898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:12.939215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:12.947425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:12.949031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:12.959352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1228/2475] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:22.884279 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=42 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:22.955050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=11 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:33.293569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:33.294109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:33.294109 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:33.312741 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] MFA Rules not processed for user `4f5721c52d6a4e2a8ae8e2c6ce9041f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:33.313924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:33.367713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1248/2476] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:54:43.361140 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:54:43.708100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:43.709586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:43.766332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208b19c-e19b-4187-838a-1d230df894a9 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:43.770999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:43.771675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:43.771985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:43.772268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:43.774077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:43.787908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:43.789413 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:43.800708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1229/2477] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:46.685408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:46.686906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:46.743891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e8d7-7afa-4bcb-87f4-cc24f2404bcd None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:46.747717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:46.748382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:46.748657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:46.748924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:46.750692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:46.765263 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:46.766740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f42bd1-cd66-4f23-a36f-fd2637b733f5 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:46.778260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1249/2478] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:51.722344 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:51.736273 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec7027-3657-44c9-a05b-b78283b9e248 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:51.742711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:51.743358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:51.743645 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:51.744034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:51.745722 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:51.806296 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:51.807823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:51.817423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1230/2479] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:53.403552 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:53.404121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:53.404121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:53.424548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:53.425746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:53.433625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1250/2480] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:54:53.450671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:53.462445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e30b-ebae-4876-9ca4-5992bbe9b54c service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:53.468393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81081021-59fa-47d0-981a-6cb9a281d929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:53.469112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81081021-59fa-47d0-981a-6cb9a281d929 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:53.469462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81081021-59fa-47d0-981a-6cb9a281d929 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:53.469806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81081021-59fa-47d0-981a-6cb9a281d929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:53.479911 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81081021-59fa-47d0-981a-6cb9a281d929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:53.482306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81081021-59fa-47d0-981a-6cb9a281d929 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:53.493230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1231/2481] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:54:56.222974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:56.242005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b23edd-fa2a-4b06-b312-e8cc950b6ff2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:56.242099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:56.242099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:56.242828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:56.246173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:56.246817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:56.247094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:56.247367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:56.249512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:56.263228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:56.263554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] MFA Rules not processed for user `c548901a69404c2baf8392e79f35c2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:56.264713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:56.264839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d5801-5dca-4fa7-8244-48915cd3ed93 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:56.275175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1251/2482] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:54:56.278000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1232/2483] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:54:57.868627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798bf0-2a4e-4748-bd08-ee73d6287323 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:57.869177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798bf0-2a4e-4748-bd08-ee73d6287323 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:57.869177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798bf0-2a4e-4748-bd08-ee73d6287323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:57.888951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-11798bf0-2a4e-4748-bd08-ee73d6287323 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:54:57.890146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-11798bf0-2a4e-4748-bd08-ee73d6287323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:54:57.898725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1252/2484] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:54:57.917692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:54:57.930923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673298e1-a4d8-48b7-bf33-a65ced1c74fa None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:54:57.936372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:54:57.942657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:54:57.942657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:54:57.942657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:54:57.946746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:54:57.948431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:54:57.958025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1233/2485] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:01.749954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185a08-12bc-43d9-9dc4-cf8320b107ab None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:01.750524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185a08-12bc-43d9-9dc4-cf8320b107ab None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:01.750524 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98185a08-12bc-43d9-9dc4-cf8320b107ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:01.770816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-98185a08-12bc-43d9-9dc4-cf8320b107ab None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:55:01.772097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-98185a08-12bc-43d9-9dc4-cf8320b107ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:01.783426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1253/2486] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:55:01.803035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:01.815266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a27700-e42a-4cec-a8f7-ff580ccb007d service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:01.821696 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:01.822275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:01.822559 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:01.823242 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:01.840568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:01.842382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:01.857581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1234/2487] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:07.039118 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aa8a0-5c0e-4045-a171-f72b94afbc04 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:07.039713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aa8a0-5c0e-4045-a171-f72b94afbc04 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:07.039713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24aa8a0-5c0e-4045-a171-f72b94afbc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:07.058929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a24aa8a0-5c0e-4045-a171-f72b94afbc04 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:55:07.060175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a24aa8a0-5c0e-4045-a171-f72b94afbc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:07.068029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1254/2488] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:55:07.097670 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:07.109902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbf7ad-9e4b-475d-9698-3a606a8a77b8 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:07.115451 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:07.116121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:07.116403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:07.116712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:07.125908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:07.127488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:07.140319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1235/2489] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:10.684052 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37107c-2e75-49bc-a3cf-bf789d1b61e2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:10.684597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37107c-2e75-49bc-a3cf-bf789d1b61e2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:10.684597 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37107c-2e75-49bc-a3cf-bf789d1b61e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:10.704178 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3c37107c-2e75-49bc-a3cf-bf789d1b61e2 None None] MFA Rules not processed for user `64a4e1770f3d4a79a7ae379184f094c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:55:10.705381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3c37107c-2e75-49bc-a3cf-bf789d1b61e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:10.761451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1255/2490] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:55:14.019691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:14.021126 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:14.028139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=82 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:14.033642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64227f-674f-4e91-99ea-2910f07a0b80 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:14.037618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:14.038254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:14.038534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:14.038883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:14.040875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:14.051090 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:14.052583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:14.061486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1236/2491] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:15.428798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:15.429310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:15.429396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:15.437780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=70 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:15.451528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:55:15.453907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:15.463579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1256/2492] 10.222.0.58 () {58 vars in 1016 bytes} [Mon Jul 25 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:55:15.484128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:15.498583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91250cc-d02d-4e00-a222-0fe16c131af0 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:15.504404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:15.505282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:15.505565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:15.505840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:15.515049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:15.516685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:15.527060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1237/2493] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:16.395966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:16.411706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0b37-e9d9-4374-9ae4-8a1059105ef2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:16.436662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:16.437366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:16.437605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:16.437879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:16.444561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:16.462349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:16.464280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c89c0-000b-4df7-ac0e-78cf112de4a4 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:16.477387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1257/2494] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:18.446984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:18.458552 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14980b92-c1eb-451c-b10a-df5257e066da service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:18.465092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:18.465733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:18.466011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:18.466281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:18.468066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:18.480974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:18.482557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:18.494824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1238/2495] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:26.472545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=8 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:27.010427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:27.011513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:27.011513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:27.030464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] MFA Rules not processed for user `93c4b63d65304186ba0ba06a6a31f3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:55:27.031718 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:27.038577 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1258/2496] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:55:27.347341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:27.357505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88183-a52c-4c60-914b-5589662a6af3 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:27.361132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:27.361763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:27.362047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:27.362321 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:27.364213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:27.374521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:27.376214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:27.384360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1239/2497] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:27.785932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:27.787390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:27.858918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d7a47-fd20-4e7e-981c-c4963f7b4194 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:27.863960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:27.864535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:27.864819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:27.865090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:27.866940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:27.878434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:27.880034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:27.890301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1259/2498] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:37.380763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=23 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:37.886142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=35 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:41.553248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:41.569307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f47e08-aa09-40b5-b7b9-e1b6f2c5d370 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:41.575822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:41.576516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:41.576797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:41.577246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:41.579268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:41.593076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:41.600778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:41.606926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1240/2499] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:55:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:55:51.601484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=6 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:55:54.343538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:54.345111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:55:54.359068 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25529a3-3271-41f2-82f0-38b39f8e0a54 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:54.363557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:54.364447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:54.364732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:54.365005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] PATH_INFO: `/v3/users/4f5721c52d6a4e2a8ae8e2c6ce9041f4` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:54.366194 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5721c52d6a4e2a8ae8e2c6ce9041f4)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:54.368202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:54.550508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5721c52d6a4e2a8ae8e2c6ce9041f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:54.551200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5721c52d6a4e2a8ae8e2c6ce9041f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:54.551807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5721c52d6a4e2a8ae8e2c6ce9041f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:54.563895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5721c52d6a4e2a8ae8e2c6ce9041f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:54.570903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5721c52d6a4e2a8ae8e2c6ce9041f4'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:54.676786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1260/2500] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:55:54 2022] DELETE /identity/v3/users/4f5721c52d6a4e2a8ae8e2c6ce9041f4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:55:54.914758 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:55:54.926154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa841db7-be14-4ebb-98bc-15e2cf85cba5 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:55:54.984015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:55:54.984880 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:55:54.985161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:55:54.985437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] PATH_INFO: `/v3/projects/d89f3be96fb943a6a5742c1fa08a52cc` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:55:54.986711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89f3be96fb943a6a5742c1fa08a52cc)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:55:54.988662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:55:55.113823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89f3be96fb943a6a5742c1fa08a52cc', 'request_id': 'req-549d1da8-3738-43d2-a805-0c2ba8d51c8f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:55.119478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89f3be96fb943a6a5742c1fa08a52cc', 'request_id': 'req-549d1da8-3738-43d2-a805-0c2ba8d51c8f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:55.126660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89f3be96fb943a6a5742c1fa08a52cc', 'request_id': 'req-549d1da8-3738-43d2-a805-0c2ba8d51c8f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:55.204762 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] The token cache is being invalidate because project d89f3be96fb943a6a5742c1fa08a52cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:55:55.205144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:55.205785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:55:55.207338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1241/2501] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:55:54 2022] DELETE /identity/v3/projects/d89f3be96fb943a6a5742c1fa08a52cc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:04.673215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:05.201583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:08.401091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:08.402504 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:08.459423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c7eff-9544-4822-bd03-75a5b48f842b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:08.508590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:08.509239 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:08.509527 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:08.509800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:08.511567 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:08.569487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:08.570816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:08.581328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1261/2502] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:18.575839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=68 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:37.309727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:37.311145 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:37.368829 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1da8-3738-43d2-a805-0c2ba8d51c8f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:37.372425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:37.373073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:37.373358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:37.373637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:37.375433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:37.438934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:37.440950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:37.450967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1242/2503] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:40.849164 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:40.861305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1debdb-1385-4b49-a684-68ee2ce3e55a service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:40.866658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:40.867379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:40.867802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:40.868156 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:40.870325 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:40.888272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:40.890216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:40.904216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1262/2504] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:41.401916 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:41.404159 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:41.482280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b7179-9ef9-4a38-a689-c46c7acd426c service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:41.488781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:41.489489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:41.489777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:41.490062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:41.491868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:41.506945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:41.506945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:41.517123 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1243/2505] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:41.550820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:41.553349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:41.575506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a86a47-b7b5-4455-8b21-1c62ec802e80 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:41.582557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:41.583502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:41.583861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:41.584227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] PATH_INFO: `/v3/users/64a4e1770f3d4a79a7ae379184f094c3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:41.585507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64a4e1770f3d4a79a7ae379184f094c3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:41.587501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:41.870196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64a4e1770f3d4a79a7ae379184f094c3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:41.870897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64a4e1770f3d4a79a7ae379184f094c3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:41.871506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64a4e1770f3d4a79a7ae379184f094c3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:41.884758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64a4e1770f3d4a79a7ae379184f094c3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:41.892245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c6ee1408-0012-4cf7-9806-0cf2424a9028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64a4e1770f3d4a79a7ae379184f094c3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:41.980764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1263/2506] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:56:41 2022] DELETE /identity/v3/users/64a4e1770f3d4a79a7ae379184f094c3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:42.219626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:42.239447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec7aca-baa0-4587-992b-12496d119eee service placement] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:42.283246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:42.303662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:42.304570 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:42.304859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:42.305138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] PATH_INFO: `/v3/projects/f5f8cfe0ac66430eab8ee4d9a146d026` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:42.306357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f8cfe0ac66430eab8ee4d9a146d026)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:42.308311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:42.674961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f8cfe0ac66430eab8ee4d9a146d026', 'request_id': 'req-589bf13d-a255-44f7-bc8f-dd2ba9e14810'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:42.681449 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f8cfe0ac66430eab8ee4d9a146d026', 'request_id': 'req-589bf13d-a255-44f7-bc8f-dd2ba9e14810'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:42.690987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f8cfe0ac66430eab8ee4d9a146d026', 'request_id': 'req-589bf13d-a255-44f7-bc8f-dd2ba9e14810'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:42.789491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] The token cache is being invalidate because project f5f8cfe0ac66430eab8ee4d9a146d026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:56:42.789951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:42.791402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-589bf13d-a255-44f7-bc8f-dd2ba9e14810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:42.796713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1244/2507] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:56:42 2022] DELETE /identity/v3/projects/f5f8cfe0ac66430eab8ee4d9a146d026 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:42.800927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:42.804798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:42.805265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:42.856563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:42.859060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:42.951119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1264/2508] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:42.960256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:42.960797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:42.961218 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:42.990793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:42.992596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:43.001777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1245/2509] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:43.006026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.018936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1754cd7-0728-4c52-a2ca-d0bfe5ba9f48 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.025436 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.026642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.027181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.027726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.028768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:56:43.029193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.031241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.050646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1265/2510] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:56:43.062534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.086437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef9047-af59-4100-8f46-068cd94fd2d2 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.093330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.094162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.094555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.094936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.096666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.099597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.197601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1246/2511] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:56:43 2022] POST /identity/v3/projects => generated 389 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:43.202466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.213427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500362a-aa03-47da-9037-e181642c9303 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.264691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:43.280340 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.281015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.281299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.281601 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.282302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.284445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.441838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1266/2512] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:56:43 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:43.446507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.460655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e4038-4ef2-4023-8e83-644f4bbe57c5 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.464585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.465395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.465745 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.466112 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.467231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.472351 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.492656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1247/2513] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:43.493954 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.507646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a250964-4369-41fb-881f-7f98400d8c5e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.513799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c02fe-eb94-4dd0-94d5-6ca04014f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.514981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c02fe-eb94-4dd0-94d5-6ca04014f55d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.515401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c02fe-eb94-4dd0-94d5-6ca04014f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.515737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c02fe-eb94-4dd0-94d5-6ca04014f55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.518183 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c02fe-eb94-4dd0-94d5-6ca04014f55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.519357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c02fe-eb94-4dd0-94d5-6ca04014f55d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.542243 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.546690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1267/2514] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:56:43.556240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a9d1-861e-4c84-a8bd-290858b42b95 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.561194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.562107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.562386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.562662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] PATH_INFO: `/v3/projects/a75b2bfcc3e14b92bf49fbaa2a641d52/users/b50d7411c500419c92e18dd0e22be87a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.584134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75b2bfcc3e14b92bf49fbaa2a641d52, user_id=b50d7411c500419c92e18dd0e22be87a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.586868 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.702840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1248/2515] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:43 2022] PUT /identity/v3/projects/a75b2bfcc3e14b92bf49fbaa2a641d52/users/b50d7411c500419c92e18dd0e22be87a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:43.708413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.708697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.708975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.731298 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:43.735083 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:43.832116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1268/2516] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:43.843492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:43.845346 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:43.954711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6803a-1211-4295-bf56-754f319c7bea admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:43.960857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:43.961933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:43.962238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:43.962635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:43.976736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:43.979115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:43.992685 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1249/2517] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:45.237661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:45.240941 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:45.256879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a4db4-7243-4cd5-b04f-1271828dd548 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:45.263061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:45.264031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:45.264374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:45.264653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] PATH_INFO: `/v3/users/c548901a69404c2baf8392e79f35c2b3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:45.267171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c548901a69404c2baf8392e79f35c2b3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:45.269983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:45.430944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c548901a69404c2baf8392e79f35c2b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:45.432166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c548901a69404c2baf8392e79f35c2b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:45.432829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c548901a69404c2baf8392e79f35c2b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:45.446697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c548901a69404c2baf8392e79f35c2b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:45.454130 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-d379e010-05c2-4653-a51b-b3377ddb066c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c548901a69404c2baf8392e79f35c2b3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:45.588755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1269/2518] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:56:45 2022] DELETE /identity/v3/users/c548901a69404c2baf8392e79f35c2b3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:46.114055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:46.126947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec7987-0dd3-470f-a055-f3d962e9ee74 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:46.133851 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:46.203837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:46.207375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:46.208462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:46.208678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] PATH_INFO: `/v3/projects/ccaa1a16a5f649fe8a5898edbc9cbadf` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:46.214065 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccaa1a16a5f649fe8a5898edbc9cbadf)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:46.219756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:46.351308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccaa1a16a5f649fe8a5898edbc9cbadf', 'request_id': 'req-0d686696-8bab-42a8-823f-c91b664908df'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:46.358461 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccaa1a16a5f649fe8a5898edbc9cbadf', 'request_id': 'req-0d686696-8bab-42a8-823f-c91b664908df'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:46.366877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccaa1a16a5f649fe8a5898edbc9cbadf', 'request_id': 'req-0d686696-8bab-42a8-823f-c91b664908df'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:46.469247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] The token cache is being invalidate because project ccaa1a16a5f649fe8a5898edbc9cbadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:56:46.469519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:46.470512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0d686696-8bab-42a8-823f-c91b664908df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:46.482521 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:46.483587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:46.483879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:46.492110 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1250/2519] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:56:46 2022] DELETE /identity/v3/projects/ccaa1a16a5f649fe8a5898edbc9cbadf => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:46.513510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:46.514749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:46.557973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:46.614477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1270/2520] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:46.622970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:46.623261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:46.623540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:46.673426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:46.673426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:46.692174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1251/2521] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:46.697407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:46.712778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad8015-cf35-4eb8-817f-e94dbcdec0dc None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:46.718711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:46.719444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:46.719664 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:46.720653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:46.722146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:56:46.722465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:46.725023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:46.745365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1271/2522] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:56:46.746247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:46.757510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3234-1cec-45db-8c92-004e89365ea1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:46.768856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:46.769615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:46.769945 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:46.770226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:46.770939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:46.772984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:46.899318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1252/2523] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:56:46 2022] POST /identity/v3/projects => generated 403 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:46.902192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:46.913199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8366b-d16c-4f2a-9b32-98293738ecc2 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:47.000096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:47.001061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:47.001363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:47.001643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:47.002791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:47.004815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:47.086858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1272/2524] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:56:46 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:47.091085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:47.102437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54cec8-a1d6-4cbe-ada7-92cd05968e33 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:47.107096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:47.110208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:47.110208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:47.110208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:47.110208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:47.110761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:47.122044 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1253/2525] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:47.126219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:47.137645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b49006-13c8-4f8b-9668-297281d9b014 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:47.142791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304ab7b-de01-4ef8-a2d0-c688c6049519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:47.144141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304ab7b-de01-4ef8-a2d0-c688c6049519 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:47.144432 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304ab7b-de01-4ef8-a2d0-c688c6049519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:47.144709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304ab7b-de01-4ef8-a2d0-c688c6049519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:47.145446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304ab7b-de01-4ef8-a2d0-c688c6049519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:47.147196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304ab7b-de01-4ef8-a2d0-c688c6049519 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:47.157904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1273/2526] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:47.163069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:47.173960 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fb437-bb36-4a88-ae1c-cc1249c39e98 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:47.179381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:47.180582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:47.180709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:47.180981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] PATH_INFO: `/v3/projects/af316301b0a84c27b1262798cb091818/users/27d63008e21a48d08c5096be4ee25446/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:47.199324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af316301b0a84c27b1262798cb091818, user_id=27d63008e21a48d08c5096be4ee25446, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:47.202268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:47.379082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1254/2527] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:47 2022] PUT /identity/v3/projects/af316301b0a84c27b1262798cb091818/users/27d63008e21a48d08c5096be4ee25446/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:47.385190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f357d-6672-4e42-b994-14c562a6798b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:47.385702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f357d-6672-4e42-b994-14c562a6798b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:47.386192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f357d-6672-4e42-b994-14c562a6798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:47.420758 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d82f357d-6672-4e42-b994-14c562a6798b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:47.421994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d82f357d-6672-4e42-b994-14c562a6798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:47.490352 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1274/2528] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:47.500830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:47.504046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:47.556532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:47.576526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabfec7-a43f-414d-a4fc-0b42e593ca47 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:47.582173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:47.583440 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:47.583901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:47.584361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:47.597537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:47.599153 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:47.609473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1255/2529] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:49.188208 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:49.188757 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:49.188995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:49.228044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] MFA Rules not processed for user `27d63008e21a48d08c5096be4ee25446`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:49.230585 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:49.287095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:49.344061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1275/2530] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:49.349258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:49.362889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225921-149b-4808-9866-891cf690f2fb service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:49.375999 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:49.376948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:49.378219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:49.378687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:49.379754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:49.388460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:49.525371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1256/2531] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:56:49 2022] POST /identity/v3/projects => generated 403 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:49.529616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:49.546468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c45c0-1d06-4b20-8a2c-a133b96503b7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:49.626729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:49.627706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:49.628016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:49.628291 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:49.629005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:49.631074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:49.732301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1276/2532] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:56:49 2022] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:49.735189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:49.746904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c32d9f-d4ef-45ec-a8ce-dbd3b9a47da3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:49.753436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:49.754485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:49.754876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:49.755593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:49.756478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:49.758601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:49.771742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1257/2533] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:56:49.776221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:49.818952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f4822-8cf6-461c-b77c-1e8259ade437 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:49.825888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:49.826792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:49.827076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:49.827355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] PATH_INFO: `/v3/projects/a3e4cea85c0b4394a6c085af3a06a0ac/users/8b8f65ee310c448299b2665d82cbe88b/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:49.845635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e4cea85c0b4394a6c085af3a06a0ac, user_id=8b8f65ee310c448299b2665d82cbe88b, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:49.848321 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:49.949783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1277/2534] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:49 2022] PUT /identity/v3/projects/a3e4cea85c0b4394a6c085af3a06a0ac/users/8b8f65ee310c448299b2665d82cbe88b/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:49.953772 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:49.970189 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ed8ce-abe5-4612-be6a-508b695c6d5b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:50.056826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36fac8-0bc1-493e-ad4c-de7969cf562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:50.057794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36fac8-0bc1-493e-ad4c-de7969cf562a admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:50.058229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36fac8-0bc1-493e-ad4c-de7969cf562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:50.058763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36fac8-0bc1-493e-ad4c-de7969cf562a admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:50.059842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36fac8-0bc1-493e-ad4c-de7969cf562a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:50.061683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36fac8-0bc1-493e-ad4c-de7969cf562a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:50.077357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1258/2535] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:56:50.086604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:50.094555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad092e-7f8f-40b4-8d4a-1c64c3f5697a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:50.100883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:50.102199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:50.102496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:50.102782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] PATH_INFO: `/v3/projects/a3e4cea85c0b4394a6c085af3a06a0ac/users/8b8f65ee310c448299b2665d82cbe88b/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:50.105234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e4cea85c0b4394a6c085af3a06a0ac, user_id=8b8f65ee310c448299b2665d82cbe88b, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:50.108050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:50.122878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1278/2536] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:50 2022] PUT /identity/v3/projects/a3e4cea85c0b4394a6c085af3a06a0ac/users/8b8f65ee310c448299b2665d82cbe88b/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:50.405581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:50.406060 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:50.406155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:50.441466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] MFA Rules not processed for user `b50d7411c500419c92e18dd0e22be87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:50.442392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:50.521692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1259/2537] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:50.539230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:50.541878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:50.625575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c904-cc50-4bcd-8ccc-8c376e156e93 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:50.637428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8eeffb-34b3-40f2-98f0-4af3a3ddc464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:50.638188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eeffb-34b3-40f2-98f0-4af3a3ddc464 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:50.638474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eeffb-34b3-40f2-98f0-4af3a3ddc464 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:50.638749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8eeffb-34b3-40f2-98f0-4af3a3ddc464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:50.650639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eeffb-34b3-40f2-98f0-4af3a3ddc464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:50.655002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8eeffb-34b3-40f2-98f0-4af3a3ddc464 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:50.672949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1279/2538] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:50.943646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:50.945637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:50.989655 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:51.015478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d4930-3773-4b96-a690-f6eb9b24a433 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:51.020207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:51.021005 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:51.021328 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:51.021614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:51.023423 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:51.115128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:51.116825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:51.128279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1260/2539] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:51.707972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:51.708531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:51.708531 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:51.731350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:51.740873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] MFA Rules not processed for user `8b8f65ee310c448299b2665d82cbe88b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:51.741965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:51.837933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1280/2540] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:54.059127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:54.072280 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7aba13-c1dd-4e9a-bff4-df8e3a00d938 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:54.079448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:54.080934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:54.081267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:54.081613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] PATH_INFO: `/v3/users/27d63008e21a48d08c5096be4ee25446` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:54.083598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d63008e21a48d08c5096be4ee25446)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:54.086093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:54.400547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d63008e21a48d08c5096be4ee25446'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:54.401500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d63008e21a48d08c5096be4ee25446'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:54.406972 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d63008e21a48d08c5096be4ee25446'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:54.431578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d63008e21a48d08c5096be4ee25446'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:54.441428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d63008e21a48d08c5096be4ee25446'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:54.549813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1261/2541] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:56:54 2022] DELETE /identity/v3/users/27d63008e21a48d08c5096be4ee25446 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:54.871466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:54.892278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca6a6-ed2b-4ed5-ae5f-28495905f864 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:55.038572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:55.040693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:55.041370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:55.041747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] PATH_INFO: `/v3/projects/af316301b0a84c27b1262798cb091818` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:55.044861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af316301b0a84c27b1262798cb091818)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:55.049906 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:55.162071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af316301b0a84c27b1262798cb091818', 'request_id': 'req-ec19721b-ab98-425c-b47a-0a3af305c728'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.169120 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af316301b0a84c27b1262798cb091818', 'request_id': 'req-ec19721b-ab98-425c-b47a-0a3af305c728'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.234314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af316301b0a84c27b1262798cb091818', 'request_id': 'req-ec19721b-ab98-425c-b47a-0a3af305c728'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.248351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] The token cache is being invalidate because project af316301b0a84c27b1262798cb091818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:56:55.248640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.249293 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec19721b-ab98-425c-b47a-0a3af305c728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.251018 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1281/2542] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:56:54 2022] DELETE /identity/v3/projects/af316301b0a84c27b1262798cb091818 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:55.256240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:55.258435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:55.273098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95ee93-fdbe-4018-b192-2b6204d95af2 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:55.332282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:55.339139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:55.342777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:55.342777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:55.342777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] PATH_INFO: `/v3/users/8b8f65ee310c448299b2665d82cbe88b` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:55.342777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8f65ee310c448299b2665d82cbe88b)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:55.344277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:55.363519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:55.363837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:55.364246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:55.390785 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] MFA Rules not processed for user `b50d7411c500419c92e18dd0e22be87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:55.392142 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:55.423259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:55.474971 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1282/2543] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:55.531561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8f65ee310c448299b2665d82cbe88b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.532587 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8f65ee310c448299b2665d82cbe88b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.534194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8f65ee310c448299b2665d82cbe88b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.556842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8f65ee310c448299b2665d82cbe88b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.566071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8f65ee310c448299b2665d82cbe88b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:55.692827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1262/2544] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:56:55 2022] DELETE /identity/v3/users/8b8f65ee310c448299b2665d82cbe88b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:56.083895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:56.086108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:56.149961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2116c-5630-4ca5-a7ae-1249d94eb848 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:56.202440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:56.202440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.202440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.202440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.202821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:56.202917 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:56.203834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:56.216106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:56.221625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:56.232092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1283/2545] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:56:56.255794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:56.257337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:56.275038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db291295-5360-4644-9743-d1c07ff7d3b4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:56.280713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:56.281689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.282307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.282662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] PATH_INFO: `/v3/projects/a3e4cea85c0b4394a6c085af3a06a0ac` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.284530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e4cea85c0b4394a6c085af3a06a0ac)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:56.286659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:56.333731 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31695-08b7-430b-85cd-28caa1df28bf service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:56.338605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:56.339480 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.339903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.340213 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] PATH_INFO: `/v3/users/93c4b63d65304186ba0ba06a6a31f3f3` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.341612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c4b63d65304186ba0ba06a6a31f3f3)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:56.343534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:56.394930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e4cea85c0b4394a6c085af3a06a0ac', 'request_id': 'req-a19b074f-9451-4314-b8be-b667f87cb9b4'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.401276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e4cea85c0b4394a6c085af3a06a0ac', 'request_id': 'req-a19b074f-9451-4314-b8be-b667f87cb9b4'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.407946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e4cea85c0b4394a6c085af3a06a0ac', 'request_id': 'req-a19b074f-9451-4314-b8be-b667f87cb9b4'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.489942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] The token cache is being invalidate because project a3e4cea85c0b4394a6c085af3a06a0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:56:56.489942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.489942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-a19b074f-9451-4314-b8be-b667f87cb9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.489942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1263/2546] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:56:56 2022] DELETE /identity/v3/projects/a3e4cea85c0b4394a6c085af3a06a0ac => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:56.493733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013bb67-3a4d-4a22-83b6-839491f92f0c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.494099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013bb67-3a4d-4a22-83b6-839491f92f0c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.494591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013bb67-3a4d-4a22-83b6-839491f92f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.503058 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:56.510313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:56.515593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e013bb67-3a4d-4a22-83b6-839491f92f0c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:56.516961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e013bb67-3a4d-4a22-83b6-839491f92f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:56.526407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c4b63d65304186ba0ba06a6a31f3f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.527533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c4b63d65304186ba0ba06a6a31f3f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.529332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c4b63d65304186ba0ba06a6a31f3f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.543419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c4b63d65304186ba0ba06a6a31f3f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.551366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c4b63d65304186ba0ba06a6a31f3f3'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:56.578215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1264/2547] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:56.586305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.586591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.586864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.606301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:56.607493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:56.620277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1265/2548] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:56.621283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:56.635410 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975a936-ffed-4571-89fc-49a5406df1eb None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:56.647394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1284/2549] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:56:56 2022] DELETE /identity/v3/users/93c4b63d65304186ba0ba06a6a31f3f3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:56.647544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:56.647544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.647544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.647544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.647894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:56:56.648106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:56.649962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:56.664115 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1266/2550] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:56:56.668297 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:56.756783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2b99b-b466-41a2-9469-51ebe0130a67 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:56.766943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:56.769407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.769690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.769994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.770728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:56.772818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:56.872274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1285/2551] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:56:56 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:56.876644 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:56.887460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc000b4-851e-401c-922f-0c07e014e7f7 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:56.947415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:56.948033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:56.948318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:56.948591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:56.949293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:56.951190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.019626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.021365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:57.042944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37173b-82bd-4241-b9ef-8e75bad2527d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.051838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.051838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.051838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.051838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] PATH_INFO: `/v3/projects/905222b11d434703848025ac706603ba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.053301 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] RBAC: Authorizing `identity:delete_project(project_id=905222b11d434703848025ac706603ba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.053437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1267/2552] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:56:56 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:56:57.055750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.055877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.066078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa36ee-5c6e-46ce-b855-5771ae5cac96 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.070759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.071430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.071713 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.072018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.072778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.074357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.085180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1268/2553] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:56:57.089249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.100006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4e74f-1e0b-4d78-b959-2f038eb9862e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.104838 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.105607 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.105889 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.106169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.106966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.108612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.120604 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1269/2554] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:57.124568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.135323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6fb0-1a75-46f9-9387-0ce84c05f4c1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.140334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f823f3-a3a2-48f8-806c-480f9b68ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.141205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f823f3-a3a2-48f8-806c-480f9b68ce2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.141488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f823f3-a3a2-48f8-806c-480f9b68ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.143489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f823f3-a3a2-48f8-806c-480f9b68ce2b admin admin] PATH_INFO: `/v3/projects/63e5e60d8bc0466094623789dd39da69/users/81dc340981984f0b8bfe1672c8e2377a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.157477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f823f3-a3a2-48f8-806c-480f9b68ce2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e5e60d8bc0466094623789dd39da69, user_id=81dc340981984f0b8bfe1672c8e2377a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.160191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f823f3-a3a2-48f8-806c-480f9b68ce2b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.172678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905222b11d434703848025ac706603ba', 'request_id': 'req-ec2af31c-5cf5-4f83-9237-76315036100c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:57.178841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905222b11d434703848025ac706603ba', 'request_id': 'req-ec2af31c-5cf5-4f83-9237-76315036100c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:57.233961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1270/2555] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:57 2022] PUT /identity/v3/projects/63e5e60d8bc0466094623789dd39da69/users/81dc340981984f0b8bfe1672c8e2377a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:57.245746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.246033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.246308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.256872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905222b11d434703848025ac706603ba', 'request_id': 'req-ec2af31c-5cf5-4f83-9237-76315036100c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:57.276543 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] MFA Rules not processed for user `81dc340981984f0b8bfe1672c8e2377a`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:57.277965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] The token cache is being invalidate because project 905222b11d434703848025ac706603ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:56:57.278205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:57.278337 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:57.278996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-ec2af31c-5cf5-4f83-9237-76315036100c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:57.280909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1286/2556] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:56:57 2022] DELETE /identity/v3/projects/905222b11d434703848025ac706603ba => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:57.286045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd3a0-0f6f-437d-a56e-a0a22bb8ab51 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.286331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd3a0-0f6f-437d-a56e-a0a22bb8ab51 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.286609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebd3a0-0f6f-437d-a56e-a0a22bb8ab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.292675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:57.306751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5bebd3a0-0f6f-437d-a56e-a0a22bb8ab51 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:57.311124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5bebd3a0-0f6f-437d-a56e-a0a22bb8ab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:57.321359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:57.349505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1271/2557] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:57.354033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.355394 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:57.368606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1287/2558] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:57.376122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.376411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.376689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.398590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:57.399776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:57.407926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1288/2559] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:57.412858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.421948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f941-ffa2-4c3d-aaf5-b3bd542818a2 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.425785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3f494-d64f-49a8-b7cb-1892afe03a5c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.427433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.428115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.428393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.428662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.429379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:56:57.429680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.430872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.431249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.431674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.432067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.432452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.433185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.435143 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.443593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1289/2560] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:56:57.447820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.458395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a763f2-f91b-4fb4-8ba9-2c0559ac5d0b admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.463002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.463627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.463905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.468092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.468092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.468092 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.522357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1272/2561] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:56:57.526274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.549939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1290/2562] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:57.554112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.591460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fea2cd-eea7-4c96-8c9e-79f638b2e993 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.617704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb554-2c35-43b7-8a69-6c4e5b8a077f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.622413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.623072 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.623350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.623626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.624359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.626247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.641771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:57.653843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.654516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.654798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.655072 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.655815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.657793 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.714469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1291/2563] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:56:57.718342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.729200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0bc70-6c28-460a-85e0-2c6186f65f8f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.732524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1273/2564] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:56:57.735455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.736152 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.736263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.736468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.736848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.737607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.739323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.746902 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1f30c-f356-48b0-aacf-c301111821f8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.755568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1292/2565] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:57.755691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.755691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.755691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.755691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.756113 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.756530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.758275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.770434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1274/2566] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:56:57.770623 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1521e-5e3b-4699-835e-cbce6efd29cc admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.771788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.773506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.774157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.774439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.774711 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.775590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.777085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.782383 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071150-d12d-4b8c-acf5-630f5c168c90 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.787435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.791239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.791239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.791441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1293/2567] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:57.791555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] PATH_INFO: `/v3/projects/6346a65b2a344c20b817fd6631e24598/users/160668d431d34648a59add3cc31de5ae/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.793903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.805444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef7c29-603c-4a76-9186-aba4257aae03 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.807184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6346a65b2a344c20b817fd6631e24598, user_id=160668d431d34648a59add3cc31de5ae, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.809985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.811289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eec74d-8d74-40ca-877f-125df0ef746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:57.812220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec74d-8d74-40ca-877f-125df0ef746a admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.812677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec74d-8d74-40ca-877f-125df0ef746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.812949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eec74d-8d74-40ca-877f-125df0ef746a admin admin] PATH_INFO: `/v3/projects/f2498339aca846e9b743ac7814cf3088/users/7d69a4e69db449e2afe9dce1b88c7523/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.829671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eec74d-8d74-40ca-877f-125df0ef746a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2498339aca846e9b743ac7814cf3088, user_id=7d69a4e69db449e2afe9dce1b88c7523, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:57.832949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eec74d-8d74-40ca-877f-125df0ef746a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:57.876819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1275/2568] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:57 2022] PUT /identity/v3/projects/6346a65b2a344c20b817fd6631e24598/users/160668d431d34648a59add3cc31de5ae/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:57.881749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:57.943488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1294/2569] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:57 2022] PUT /identity/v3/projects/f2498339aca846e9b743ac7814cf3088/users/7d69a4e69db449e2afe9dce1b88c7523/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:57.944076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca6e72-98f7-414d-8f4d-72d17dd1a8d4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:57.953970 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:57.954368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:57.954653 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:57.986448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] MFA Rules not processed for user `7d69a4e69db449e2afe9dce1b88c7523`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:57.988549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:57.997730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:58.005353 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:58.006021 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:58.006302 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:58.006578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:58.007303 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:58.008930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:58.019836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1276/2570] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:56:58.023966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:58.034747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b372c-eff6-4987-852a-49fa21520b83 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:58.039556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ff3de-e4a6-46ba-b57f-4560c86aa61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:58.040498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ff3de-e4a6-46ba-b57f-4560c86aa61f admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:58.040780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ff3de-e4a6-46ba-b57f-4560c86aa61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:58.041175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ff3de-e4a6-46ba-b57f-4560c86aa61f admin admin] PATH_INFO: `/v3/projects/6346a65b2a344c20b817fd6631e24598/users/160668d431d34648a59add3cc31de5ae/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:58.043310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ff3de-e4a6-46ba-b57f-4560c86aa61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6346a65b2a344c20b817fd6631e24598, user_id=160668d431d34648a59add3cc31de5ae, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:58.046094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ff3de-e4a6-46ba-b57f-4560c86aa61f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:58.057339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1277/2571] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:56:58 2022] PUT /identity/v3/projects/6346a65b2a344c20b817fd6631e24598/users/160668d431d34648a59add3cc31de5ae/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:56:58.057919 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1295/2572] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:56:58.067744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:58.068073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:58.071101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:58.080956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:58.082498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:58.100596 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] MFA Rules not processed for user `160668d431d34648a59add3cc31de5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:58.101984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:58.126791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:58.161983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb2aa5-cef8-426a-914a-15878c64f869 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:58.177454 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1278/2573] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:58.189404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:58.191475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:58.224736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaa5ad-23f8-4c88-bc0e-2f067689f9d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:58.225431 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa5ad-23f8-4c88-bc0e-2f067689f9d3 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:58.225720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa5ad-23f8-4c88-bc0e-2f067689f9d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:58.225999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaa5ad-23f8-4c88-bc0e-2f067689f9d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:58.251591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc166a-1f32-413d-baa9-59584b7df4db None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:58.251591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:58.251591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:58.251591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:58.252062 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:58.262593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:58.264095 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:58.274927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1279/2574] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:56:58.284650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaa5ad-23f8-4c88-bc0e-2f067689f9d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:58.286245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaa5ad-23f8-4c88-bc0e-2f067689f9d3 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:58.296076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1296/2575] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:56:58.428706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:59.303479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:59.369078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5d0e5-61e1-4305-a8fb-9139ec83d8e4 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:59.374367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:59.375452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:59.382958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:59.382958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] PATH_INFO: `/v3/users/81dc340981984f0b8bfe1672c8e2377a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:59.382958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81dc340981984f0b8bfe1672c8e2377a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:59.382958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:59.659011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81dc340981984f0b8bfe1672c8e2377a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:59.659631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81dc340981984f0b8bfe1672c8e2377a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:59.660255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81dc340981984f0b8bfe1672c8e2377a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:59.671961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:56:59.674212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81dc340981984f0b8bfe1672c8e2377a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:59.683322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81dc340981984f0b8bfe1672c8e2377a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:56:59.800519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1280/2576] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:56:59 2022] DELETE /identity/v3/users/81dc340981984f0b8bfe1672c8e2377a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:56:59.805133 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:59.805627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:59.805736 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:59.825886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:56:59.827103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:59.886905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1297/2577] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:56:59.897757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:56:59.899162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:56:59.958807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a528-30e2-436c-a3bb-2f88c3dfce35 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:56:59.962876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:56:59.963537 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:56:59.967053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:56:59.967053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:56:59.973996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:56:59.975507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:56:59.985467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1281/2578] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:00.541563 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:00.543889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:00.557942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da033ad-2aef-47f4-bf1f-00d3cccf047f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:00.563483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:00.564660 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:00.565138 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:00.565786 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] PATH_INFO: `/v3/projects/63e5e60d8bc0466094623789dd39da69` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:00.567759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e5e60d8bc0466094623789dd39da69)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:00.569982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:00.674905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e5e60d8bc0466094623789dd39da69', 'request_id': 'req-fb32829b-0024-42ef-9915-f7d1c67f2ccd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:00.681282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e5e60d8bc0466094623789dd39da69', 'request_id': 'req-fb32829b-0024-42ef-9915-f7d1c67f2ccd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:00.805446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e5e60d8bc0466094623789dd39da69', 'request_id': 'req-fb32829b-0024-42ef-9915-f7d1c67f2ccd'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:00.818411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] The token cache is being invalidate because project 63e5e60d8bc0466094623789dd39da69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:00.818650 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:00.820070 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:00.824503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1298/2579] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:00 2022] DELETE /identity/v3/projects/63e5e60d8bc0466094623789dd39da69 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:00.826611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:00.839877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef015-4269-41fd-9521-0b16663decf5 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:00.912861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:00.913752 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:00.914034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:00.914313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] PATH_INFO: `/v3/users/160668d431d34648a59add3cc31de5ae` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:00.915707 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=160668d431d34648a59add3cc31de5ae)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:00.917512 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:01.095897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160668d431d34648a59add3cc31de5ae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.096591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160668d431d34648a59add3cc31de5ae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.097942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160668d431d34648a59add3cc31de5ae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.111737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160668d431d34648a59add3cc31de5ae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.119426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160668d431d34648a59add3cc31de5ae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.202136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1282/2580] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:00 2022] DELETE /identity/v3/users/160668d431d34648a59add3cc31de5ae => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:01.541798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:01.541798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:01.556173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32829b-0024-42ef-9915-f7d1c67f2ccd admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:01.622819 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:01.623696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:01.624010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:01.624422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] PATH_INFO: `/v3/users/7d69a4e69db449e2afe9dce1b88c7523` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:01.625679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d69a4e69db449e2afe9dce1b88c7523)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:01.627898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:01.639850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:01.836341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d69a4e69db449e2afe9dce1b88c7523'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.837023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d69a4e69db449e2afe9dce1b88c7523'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.837586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d69a4e69db449e2afe9dce1b88c7523'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.849421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d69a4e69db449e2afe9dce1b88c7523'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.856901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-809dbdd8-5b2d-42a5-9adb-bfb06b4d6d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d69a4e69db449e2afe9dce1b88c7523'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:01.861135 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:01.862991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:01.871452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:01.877015 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec483c2c-4d63-43cf-ac73-3a885b1c38ad admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:01.883297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:01.884214 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:01.884500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:01.884776 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] PATH_INFO: `/v3/projects/6346a65b2a344c20b817fd6631e24598` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:01.886197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6346a65b2a344c20b817fd6631e24598)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:01.888210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:01.949349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1299/2581] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:01 2022] DELETE /identity/v3/users/7d69a4e69db449e2afe9dce1b88c7523 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:01.953798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:01.954108 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:01.954375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:01.973416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:01.974634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.029841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6346a65b2a344c20b817fd6631e24598', 'request_id': 'req-713fcabd-4449-4f08-bb25-2ffe55bab2db'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.035875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6346a65b2a344c20b817fd6631e24598', 'request_id': 'req-713fcabd-4449-4f08-bb25-2ffe55bab2db'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.042698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1300/2582] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:02.043520 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6346a65b2a344c20b817fd6631e24598', 'request_id': 'req-713fcabd-4449-4f08-bb25-2ffe55bab2db'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.050734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.052220 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.109029 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86c81c-5737-4530-a185-fb547d3bf476 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.120979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] The token cache is being invalidate because project 6346a65b2a344c20b817fd6631e24598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:02.121272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.121906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-713fcabd-4449-4f08-bb25-2ffe55bab2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.123751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1283/2583] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:01 2022] DELETE /identity/v3/projects/6346a65b2a344c20b817fd6631e24598 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:02.128901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ecf19-6fbb-4b47-b958-6ec20e8d92ba None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.129349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ecf19-6fbb-4b47-b958-6ec20e8d92ba None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.129677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ecf19-6fbb-4b47-b958-6ec20e8d92ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.149946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-654ecf19-6fbb-4b47-b958-6ec20e8d92ba None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:02.151150 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-654ecf19-6fbb-4b47-b958-6ec20e8d92ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.151668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:02.159128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.160631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.166533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.166533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.166533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.212022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1284/2584] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:02.221503 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.221798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.222610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.225123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.226652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.236449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1301/2585] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:57:02.247289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:02.248624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.257452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1285/2586] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:02.261639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.271244 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc9743-c182-4554-beaa-7fd4c1cb99a2 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.276097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.276755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.277036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.277309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.278033 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:02.278338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.280195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.293314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1302/2587] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:57:02.298052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.308510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f19c9-73d9-4359-ac09-a3a5b86b2ba0 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.313545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.314204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.314494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.314770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.315646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.318986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.407750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1286/2588] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:02 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:02.413008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.423324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18f81a-375a-486b-a589-b546ecc4cb7d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.490990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.492022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.492309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.492616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.493296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.495228 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.612385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1303/2589] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:02 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:57:02.614337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.625595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df9ec-a8e5-4889-bb6f-0267f73b0055 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.631323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.632130 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.632408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.633448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.633448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.635007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.645697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1287/2590] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:02.649806 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.660193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1bfda-796b-474e-8635-7d53980f7bc6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.662714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.664500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.666652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.667496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.667781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.668348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.669049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.670861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.678367 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faaab0-1adc-453c-a0f4-9a08247a305c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.683753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.684215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1304/2591] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:02.684682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.684993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.685282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] PATH_INFO: `/v3/projects/f2498339aca846e9b743ac7814cf3088` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.686475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2498339aca846e9b743ac7814cf3088)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.688309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:02.688642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.702323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a712-7d51-44e0-a6b1-21130fba7ac7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:02.708448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7110d7-1aa6-409a-b917-15674f55213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:02.709487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7110d7-1aa6-409a-b917-15674f55213c admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.710307 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7110d7-1aa6-409a-b917-15674f55213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.710572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7110d7-1aa6-409a-b917-15674f55213c admin admin] PATH_INFO: `/v3/projects/91b802ddb82b45a4a804c20070d30509/users/746b16e34abc42d389e2e3920c7e52b3/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.730528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7110d7-1aa6-409a-b917-15674f55213c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b802ddb82b45a4a804c20070d30509, user_id=746b16e34abc42d389e2e3920c7e52b3, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:02.733377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7110d7-1aa6-409a-b917-15674f55213c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:02.864207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1305/2592] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:02 2022] PUT /identity/v3/projects/91b802ddb82b45a4a804c20070d30509/users/746b16e34abc42d389e2e3920c7e52b3/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:02.865811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:02.872452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2498339aca846e9b743ac7814cf3088', 'request_id': 'req-b3976bcf-7038-431f-9821-0a5d192a70a3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.874751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:02.875044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:02.875324 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:02.879176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2498339aca846e9b743ac7814cf3088', 'request_id': 'req-b3976bcf-7038-431f-9821-0a5d192a70a3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.886047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2498339aca846e9b743ac7814cf3088', 'request_id': 'req-b3976bcf-7038-431f-9821-0a5d192a70a3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:02.904750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] MFA Rules not processed for user `746b16e34abc42d389e2e3920c7e52b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:02.905927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:02.930666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:02.969386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1306/2593] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:02.974519 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.036692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11ad55-d96b-4f44-8afc-abc856f7e128 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.041268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.041910 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.042191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.042463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.043147 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.045057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.045186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] The token cache is being invalidate because project f2498339aca846e9b743ac7814cf3088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:03.045393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:03.046052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-b3976bcf-7038-431f-9821-0a5d192a70a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:03.047616 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1288/2594] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:02 2022] DELETE /identity/v3/projects/f2498339aca846e9b743ac7814cf3088 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:03.053877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9289c2-fd9c-4495-81d7-354c14d45b1e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.056768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9289c2-fd9c-4495-81d7-354c14d45b1e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.056768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9289c2-fd9c-4495-81d7-354c14d45b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.073611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6d9289c2-fd9c-4495-81d7-354c14d45b1e None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:03.074820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6d9289c2-fd9c-4495-81d7-354c14d45b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.083040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1289/2595] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:03.092447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.092732 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.093008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.113240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:03.114510 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.122381 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1290/2596] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:03.126371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.135590 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927aa9-e628-40cd-b416-ccfdcbacca1b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.140307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.140935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.141268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.141540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.142256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:03.142565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.144345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.153047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1307/2597] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:02 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:57:03.154559 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.171334 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1291/2598] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:57:03.171510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.171613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.171613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2d4a4-eec2-4a77-9f5d-92b152558452 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.225996 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd28c9-fdf4-465b-8d74-d8f0e712e57d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.230579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.231193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.231358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.231547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.231824 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.232016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.232166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.232441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.232586 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.233155 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.234561 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.235255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.337499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1308/2599] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:03.341357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.353028 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac57f4-6b2a-44e4-9d5b-d4d4d8e61772 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.358364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.359042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.360808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.360808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.360808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.363277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.363958 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1292/2600] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:03.367857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.373707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1309/2601] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:03.378125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.388523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390c595-e781-4f20-8c30-1874da187a87 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.416803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:03.447122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c407-8fb5-4a4e-813e-0cd78a758c2e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.447122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.447122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.447122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.447671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.447671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.447671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.447964 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.448556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.448863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.449363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] PATH_INFO: `/v3/projects/e1682d3c3e2b4e5b8305b84563b9ec69/users/7b53137ef7d04eb9a364a24f2b18198a/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.466124 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1682d3c3e2b4e5b8305b84563b9ec69, user_id=7b53137ef7d04eb9a364a24f2b18198a, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.468807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.552246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1293/2602] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:57:03.553213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.554824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1310/2603] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:03 2022] PUT /identity/v3/projects/e1682d3c3e2b4e5b8305b84563b9ec69/users/7b53137ef7d04eb9a364a24f2b18198a/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:03.558791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.564013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b11a4-3346-49d2-90c5-6d81456d61db admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.578108 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:03.623303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77478f-e3b8-4b6d-920a-e6c04500811f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.623549 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.624313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.624691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.624996 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.625749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.627369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.628961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.629658 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.629940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.630248 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.630985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.632649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.639241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1294/2604] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:03.643703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.646526 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1311/2605] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:03.654295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dfa67-35b6-47c5-b3cf-d55e84ec3bf9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.655608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.659274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.659987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.660279 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.660556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.661337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.663409 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.665960 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0252fa9-e5c5-4100-8c9a-60e1190fbe2f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.670663 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2147fd-8e5d-4824-bbd6-9713c171f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.671522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2147fd-8e5d-4824-bbd6-9713c171f6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.671802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2147fd-8e5d-4824-bbd6-9713c171f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.672114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2147fd-8e5d-4824-bbd6-9713c171f6c1 admin admin] PATH_INFO: `/v3/projects/e1682d3c3e2b4e5b8305b84563b9ec69/users/7b53137ef7d04eb9a364a24f2b18198a/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.673870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1295/2606] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:03.676300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2147fd-8e5d-4824-bbd6-9713c171f6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1682d3c3e2b4e5b8305b84563b9ec69, user_id=7b53137ef7d04eb9a364a24f2b18198a, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.678053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.679255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2147fd-8e5d-4824-bbd6-9713c171f6c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.688723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff3527-baec-4d5d-817b-ef76d1d49ae8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.696049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1312/2607] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:03 2022] PUT /identity/v3/projects/e1682d3c3e2b4e5b8305b84563b9ec69/users/7b53137ef7d04eb9a364a24f2b18198a/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:03.701719 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.701947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.702222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.731949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] MFA Rules not processed for user `7b53137ef7d04eb9a364a24f2b18198a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:03.733294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.754035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af095ea6-d9c3-4daa-bdc4-4be8114a499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.755067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af095ea6-d9c3-4daa-bdc4-4be8114a499c admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.755348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af095ea6-d9c3-4daa-bdc4-4be8114a499c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.755623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af095ea6-d9c3-4daa-bdc4-4be8114a499c admin admin] PATH_INFO: `/v3/projects/444b592916564c41a07b2b653b896e76/users/8a8c16fdf36e400ca2998f583a945b48/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.776931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af095ea6-d9c3-4daa-bdc4-4be8114a499c admin admin] RBAC: Authorizing `identity:create_grant(project_id=444b592916564c41a07b2b653b896e76, user_id=8a8c16fdf36e400ca2998f583a945b48, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:03.780186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af095ea6-d9c3-4daa-bdc4-4be8114a499c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:03.813089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1313/2608] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:03.825077 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.826533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.848543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:03.868965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1296/2609] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:03 2022] PUT /identity/v3/projects/444b592916564c41a07b2b653b896e76/users/8a8c16fdf36e400ca2998f583a945b48/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:03.880693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.880976 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.881257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.889728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dd88b-8a5c-4778-bdcc-f00fed797ec1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:03.913538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] MFA Rules not processed for user `8a8c16fdf36e400ca2998f583a945b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:03.914757 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.949257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:03.950260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:03.950642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:03.951121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:03.953229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:03.981959 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1297/2610] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:03.993226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:03.995069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:04.008020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4629-a58d-4a0f-8f73-63931510cfd6 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:04.012020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:04.012697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:04.012986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:04.013385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:04.014154 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:04.015592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:04.022252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:04.023714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:04.024755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1314/2611] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:04.035165 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1298/2612] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:57:08.795047 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:08.804435 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3848e-3de8-4dfc-bdce-f0e063428cfe service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:08.808063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9124477-a4b0-4394-bee7-1f0619ace3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:08.808693 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124477-a4b0-4394-bee7-1f0619ace3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:08.808974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124477-a4b0-4394-bee7-1f0619ace3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:08.809249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9124477-a4b0-4394-bee7-1f0619ace3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:08.870771 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124477-a4b0-4394-bee7-1f0619ace3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:08.872250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9124477-a4b0-4394-bee7-1f0619ace3a1 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:08.883449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1315/2613] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:14.030457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:15.616906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:15.686292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acbf0f7-3fcc-4982-b0a5-a64d2209b246 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:15.693085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:15.694202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:15.694330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:15.694585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] PATH_INFO: `/v3/users/8a8c16fdf36e400ca2998f583a945b48` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:15.695821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8c16fdf36e400ca2998f583a945b48)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:15.697822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:15.877564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8c16fdf36e400ca2998f583a945b48'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:15.878775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8c16fdf36e400ca2998f583a945b48'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:15.879392 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8c16fdf36e400ca2998f583a945b48'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:15.891482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8c16fdf36e400ca2998f583a945b48'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:15.899275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8c16fdf36e400ca2998f583a945b48'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:15.971324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1299/2614] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:15 2022] DELETE /identity/v3/users/8a8c16fdf36e400ca2998f583a945b48 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:15.976230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:15.976716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:15.976817 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:15.996379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:16.006190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:16.016420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=100 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:16.058586 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1316/2615] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:16.069176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:16.075963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:16.128770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822f527-656e-4322-b508-635509318fd7 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:16.132493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff925a-2716-402f-a519-d9b57c77f917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:16.133132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff925a-2716-402f-a519-d9b57c77f917 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:16.133456 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff925a-2716-402f-a519-d9b57c77f917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:16.133738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff925a-2716-402f-a519-d9b57c77f917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:16.142698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff925a-2716-402f-a519-d9b57c77f917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:16.144840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff925a-2716-402f-a519-d9b57c77f917 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:16.154448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1300/2616] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:16.578111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:16.579605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:16.592560 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17046376-ffd0-437b-949b-d0328c061e09 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:16.597673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:16.598666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:16.598944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:16.599225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] PATH_INFO: `/v3/projects/444b592916564c41a07b2b653b896e76` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:16.600451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] RBAC: Authorizing `identity:delete_project(project_id=444b592916564c41a07b2b653b896e76)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:16.602698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:16.715063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444b592916564c41a07b2b653b896e76', 'request_id': 'req-e9e8a602-f88d-40ab-93b2-5c800b46062f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:16.720809 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444b592916564c41a07b2b653b896e76', 'request_id': 'req-e9e8a602-f88d-40ab-93b2-5c800b46062f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:16.801048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444b592916564c41a07b2b653b896e76', 'request_id': 'req-e9e8a602-f88d-40ab-93b2-5c800b46062f'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:16.813501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] The token cache is being invalidate because project 444b592916564c41a07b2b653b896e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:16.813793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:16.814439 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e9e8a602-f88d-40ab-93b2-5c800b46062f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:16.816850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1317/2617] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:16 2022] DELETE /identity/v3/projects/444b592916564c41a07b2b653b896e76 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:16.821861 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:16.822361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:16.822457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:16.844385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:16.844385 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:16.860973 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:16.903781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1301/2618] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:16.911896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:16.912207 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:16.912483 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:16.933074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:16.934241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:16.942905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1318/2619] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:16.947361 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:16.956892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5fb00-42c1-483f-8e96-ef5786dec5ad None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:16.961625 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:16.962284 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:16.962562 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:16.962834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:16.963554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:16.964924 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:16.966527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:16.981176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1302/2620] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:57:16.983823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:16.994280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49d795-fc2a-47ff-ab89-3e606be6b64d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:16.999095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:16.999747 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.000069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.000349 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.001051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:17.005309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:17.202126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1319/2621] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:16 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:17.206412 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:17.217657 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44672d-ebaf-47fa-828a-e6bfe2c7ea51 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:17.278178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:17.278847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.279248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.279434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.280111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:17.282016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:17.452618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1303/2622] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:17 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:17.456141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:17.467396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844156f-7f3d-4786-bbe2-86edd656bb08 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:17.472013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:17.473339 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.474645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.474958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.475686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:17.477316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:17.487247 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1320/2623] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:17.491467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:17.502155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48117a7e-c23d-4ea1-8a0a-27d998cb4ee1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:17.507252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c23919-47e0-4439-a10b-84f632406e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:17.507930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23919-47e0-4439-a10b-84f632406e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.508227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23919-47e0-4439-a10b-84f632406e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.508505 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c23919-47e0-4439-a10b-84f632406e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.509225 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c23919-47e0-4439-a10b-84f632406e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:17.511040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c23919-47e0-4439-a10b-84f632406e1c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:17.522547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1304/2624] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:17.526835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:17.537798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfc685-56b0-4d45-a403-827038026c90 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:17.542538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:17.543407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.543688 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.543992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] PATH_INFO: `/v3/projects/60603f05d3e446f6aa9d175d9ae6b685/users/d5062fffd7974f0c8f6fc9934e20a01a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.558635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60603f05d3e446f6aa9d175d9ae6b685, user_id=d5062fffd7974f0c8f6fc9934e20a01a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:17.561336 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:17.610616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1321/2625] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:17 2022] PUT /identity/v3/projects/60603f05d3e446f6aa9d175d9ae6b685/users/d5062fffd7974f0c8f6fc9934e20a01a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:17.627204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.627497 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.627777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.656069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] MFA Rules not processed for user `d5062fffd7974f0c8f6fc9934e20a01a`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:17.657274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:17.720356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1305/2626] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:17.732041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:17.733730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:17.779787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:17.806679 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42501f-d90c-4493-9c55-733eb8e04f47 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:17.812200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a31b-aa40-4773-a84d-c14009dbf9cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:17.812838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a31b-aa40-4773-a84d-c14009dbf9cc service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:17.813119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a31b-aa40-4773-a84d-c14009dbf9cc service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:17.813393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a31b-aa40-4773-a84d-c14009dbf9cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:17.821744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a31b-aa40-4773-a84d-c14009dbf9cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:17.823302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a31b-aa40-4773-a84d-c14009dbf9cc service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:17.833253 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1322/2627] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:18.056330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:18.071306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:18.115185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a29ffa-dc23-4b6c-bb1a-957deee1f071 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:18.119801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:18.120709 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:18.120998 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:18.121277 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] PATH_INFO: `/v3/users/d5062fffd7974f0c8f6fc9934e20a01a` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:18.122473 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5062fffd7974f0c8f6fc9934e20a01a)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:18.124439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:18.293995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5062fffd7974f0c8f6fc9934e20a01a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:18.294656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5062fffd7974f0c8f6fc9934e20a01a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:18.295262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5062fffd7974f0c8f6fc9934e20a01a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:18.307578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5062fffd7974f0c8f6fc9934e20a01a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:18.314571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5062fffd7974f0c8f6fc9934e20a01a'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:18.410751 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1306/2628] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:18 2022] DELETE /identity/v3/users/d5062fffd7974f0c8f6fc9934e20a01a => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:18.415417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:18.415877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:18.416041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:18.435549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:18.436810 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:18.497316 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1323/2629] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:18.508067 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:18.509488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:18.566964 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17d95-281f-4387-a29e-4f4a28bfa90b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:18.570858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d215f0f-cfeb-4db9-82d7-5d7bdd25f4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:18.571521 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d215f0f-cfeb-4db9-82d7-5d7bdd25f4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:18.571803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d215f0f-cfeb-4db9-82d7-5d7bdd25f4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:18.572105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d215f0f-cfeb-4db9-82d7-5d7bdd25f4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:18.581833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d215f0f-cfeb-4db9-82d7-5d7bdd25f4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:18.583262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d215f0f-cfeb-4db9-82d7-5d7bdd25f4d5 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:18.592737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1307/2630] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:19.036287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.037783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:19.050924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d08495-8170-41c4-a502-314c7855b0f6 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.056044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.056878 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.057161 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.057437 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] PATH_INFO: `/v3/projects/60603f05d3e446f6aa9d175d9ae6b685` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.058631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60603f05d3e446f6aa9d175d9ae6b685)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.060590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.165927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60603f05d3e446f6aa9d175d9ae6b685', 'request_id': 'req-2f0dd664-54bd-466e-a4eb-5f8fd318c340'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:19.171640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60603f05d3e446f6aa9d175d9ae6b685', 'request_id': 'req-2f0dd664-54bd-466e-a4eb-5f8fd318c340'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:19.250913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60603f05d3e446f6aa9d175d9ae6b685', 'request_id': 'req-2f0dd664-54bd-466e-a4eb-5f8fd318c340'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:19.262884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] The token cache is being invalidate because project 60603f05d3e446f6aa9d175d9ae6b685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:19.263200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:19.263824 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-2f0dd664-54bd-466e-a4eb-5f8fd318c340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:19.265496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1324/2631] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:19 2022] DELETE /identity/v3/projects/60603f05d3e446f6aa9d175d9ae6b685 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:19.271238 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.271710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.271821 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.293591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:19.294840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:19.329227 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:19.355719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1308/2632] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:19.364904 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.365192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.365473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.385366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:19.386561 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:19.394673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1325/2633] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:19.399139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.409379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268caf3-2daa-4113-8e51-c9c3912c5a48 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.414533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.415180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.416382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.416382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.416583 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:19.416785 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.418371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.431138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1309/2634] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:57:19.435428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.445125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4238c-8d1c-4d41-b856-69c72450954d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.450814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.451465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.451749 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.452064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.452766 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.454647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.612853 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1326/2635] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:19 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:19.617347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.627539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d290a56-1566-442c-b760-887b6f238f58 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.690029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.690710 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.691007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.691345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.692308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.694205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.799817 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1310/2636] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:19 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:19.804106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.814839 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105d38e-8fc5-45bc-b1f6-4e136f6684ff admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.822959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.823629 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.823936 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.824237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.824953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.826690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.841821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1327/2637] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:19.843516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.854105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f16cb-ee57-4777-88db-9f4cea86eb3f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.858913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ffa88-7348-47c4-9e9b-274d70a1fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.859568 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ffa88-7348-47c4-9e9b-274d70a1fb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.859850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ffa88-7348-47c4-9e9b-274d70a1fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.860201 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ffa88-7348-47c4-9e9b-274d70a1fb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.860979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ffa88-7348-47c4-9e9b-274d70a1fb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.862555 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ffa88-7348-47c4-9e9b-274d70a1fb98 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.877249 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1311/2638] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:19.878687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:19.888862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72781d-0b1c-412b-a80c-400646d2f3b7 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:19.893489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:19.895002 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:19.895294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:19.895678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] PATH_INFO: `/v3/projects/3d53b974936041aaa636c91bc2832526/users/4528f7ed6ed243a2aa0e4ac2abd3759a/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:19.907043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:19.911861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d53b974936041aaa636c91bc2832526, user_id=4528f7ed6ed243a2aa0e4ac2abd3759a, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:19.914569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:19.991763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1328/2639] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:19 2022] PUT /identity/v3/projects/3d53b974936041aaa636c91bc2832526/users/4528f7ed6ed243a2aa0e4ac2abd3759a/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:20.003452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.003747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.004168 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.031933 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] MFA Rules not processed for user `4528f7ed6ed243a2aa0e4ac2abd3759a`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:20.033217 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:20.099191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1312/2640] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:20.103862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.166742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cef5e-9873-4e76-a0e5-0112a607fd88 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.171421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.172129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.172410 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.172685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.173370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.175269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.276132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1329/2641] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:20 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:20.280203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.291654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cd93a-7b21-4ba6-9075-1b9212a6359d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.324668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:20.348937 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.349610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.349896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.350175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.350878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.352816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.463128 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1313/2642] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:20 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:57:20.467172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.477893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96932a7-e988-4d57-a111-fd7fcb329e51 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.482630 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.483284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.483566 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.483842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.484797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.486390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.497533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1330/2643] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:20.501797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.512697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e56e-cc91-47db-99fc-c382ea3ed4b0 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.517266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.518206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.518420 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.518695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] PATH_INFO: `/v3/projects/7e4ad67a98474cd19ae75e01a7eb8a7b/users/04ebebc39b5f45b8862cbbd29fc6a42c/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.533479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4ad67a98474cd19ae75e01a7eb8a7b, user_id=04ebebc39b5f45b8862cbbd29fc6a42c, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.536167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.610997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1314/2644] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:20 2022] PUT /identity/v3/projects/7e4ad67a98474cd19ae75e01a7eb8a7b/users/04ebebc39b5f45b8862cbbd29fc6a42c/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:20.616496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.626288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedaa88-9815-4483-8c5d-5cfab80b5ef9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.682132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7866c-a98b-45d4-84ed-0ca819ac259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.682905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7866c-a98b-45d4-84ed-0ca819ac259e admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.683241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7866c-a98b-45d4-84ed-0ca819ac259e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.683533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7866c-a98b-45d4-84ed-0ca819ac259e admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.684333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7866c-a98b-45d4-84ed-0ca819ac259e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.685947 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7866c-a98b-45d4-84ed-0ca819ac259e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.703242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1331/2645] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:20.707405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.717805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357220f-050b-4cda-a80f-a9ca3c1fbe68 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.722493 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.723488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.723771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.724088 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] PATH_INFO: `/v3/projects/7e4ad67a98474cd19ae75e01a7eb8a7b/users/04ebebc39b5f45b8862cbbd29fc6a42c/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.726101 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4ad67a98474cd19ae75e01a7eb8a7b, user_id=04ebebc39b5f45b8862cbbd29fc6a42c, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.728773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.739830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1315/2646] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:20 2022] PUT /identity/v3/projects/7e4ad67a98474cd19ae75e01a7eb8a7b/users/04ebebc39b5f45b8862cbbd29fc6a42c/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:20.749780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.750096 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.750373 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.778714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] MFA Rules not processed for user `04ebebc39b5f45b8862cbbd29fc6a42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:20.779991 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:20.824981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:20.845305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1332/2647] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:20.856386 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:20.871254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:20.915627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e801974-812e-4cea-ad06-dacdae753949 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:20.919308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280168d-68aa-41e4-8dbe-df9642b1eddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:20.919967 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280168d-68aa-41e4-8dbe-df9642b1eddf service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:20.920257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280168d-68aa-41e4-8dbe-df9642b1eddf service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:20.920535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280168d-68aa-41e4-8dbe-df9642b1eddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:20.930029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280168d-68aa-41e4-8dbe-df9642b1eddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:20.931453 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280168d-68aa-41e4-8dbe-df9642b1eddf service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:20.941265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1316/2648] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:22.180993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:22.243735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e913df-f9a7-4f06-b7a4-cbf6316930d9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:22.248303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:22.249162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:22.249443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:22.249715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] PATH_INFO: `/v3/users/4528f7ed6ed243a2aa0e4ac2abd3759a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:22.250922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4528f7ed6ed243a2aa0e4ac2abd3759a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:22.252905 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:22.477603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4528f7ed6ed243a2aa0e4ac2abd3759a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:22.478275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4528f7ed6ed243a2aa0e4ac2abd3759a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:22.479001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4528f7ed6ed243a2aa0e4ac2abd3759a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:22.491411 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4528f7ed6ed243a2aa0e4ac2abd3759a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:22.498472 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4528f7ed6ed243a2aa0e4ac2abd3759a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:22.583024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1333/2649] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:22 2022] DELETE /identity/v3/users/4528f7ed6ed243a2aa0e4ac2abd3759a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:22.587631 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:22.588137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:22.590151 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:22.606924 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:22.608198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:22.667330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1317/2650] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:22.677423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:22.678825 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:22.735706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde19cca-a63e-4fa6-bb80-f924de5a806c admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:22.740074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:22.740707 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:22.740987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:22.741264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:22.750102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:22.751520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:22.761706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1334/2651] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:23.172893 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:23.178566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:23.187453 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5d0d-e465-4b02-a82b-ef74ced5286b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:23.193532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:23.194402 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:23.194693 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:23.194965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] PATH_INFO: `/v3/projects/3d53b974936041aaa636c91bc2832526` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:23.196185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d53b974936041aaa636c91bc2832526)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:23.198087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:23.292870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:23.309182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d53b974936041aaa636c91bc2832526', 'request_id': 'req-fbeb62c5-6a29-4554-836d-9b3431983a99'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.314501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d53b974936041aaa636c91bc2832526', 'request_id': 'req-fbeb62c5-6a29-4554-836d-9b3431983a99'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.320788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d53b974936041aaa636c91bc2832526', 'request_id': 'req-fbeb62c5-6a29-4554-836d-9b3431983a99'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.411874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] The token cache is being invalidate because project 3d53b974936041aaa636c91bc2832526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:23.412192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.412845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.414436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1318/2652] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:23 2022] DELETE /identity/v3/projects/3d53b974936041aaa636c91bc2832526 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:23.418600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:23.429143 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f52c45-f0bd-4aa1-8e92-c42938583afb service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:23.432813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:23.486929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:23.487791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:23.488393 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:23.488710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] PATH_INFO: `/v3/users/04ebebc39b5f45b8862cbbd29fc6a42c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:23.489922 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ebebc39b5f45b8862cbbd29fc6a42c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:23.491862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:23.688065 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ebebc39b5f45b8862cbbd29fc6a42c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.688763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ebebc39b5f45b8862cbbd29fc6a42c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.689401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ebebc39b5f45b8862cbbd29fc6a42c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.701896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ebebc39b5f45b8862cbbd29fc6a42c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.709644 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ebebc39b5f45b8862cbbd29fc6a42c'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:23.799501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1335/2653] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:23 2022] DELETE /identity/v3/users/04ebebc39b5f45b8862cbbd29fc6a42c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:24.174698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:24.176842 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:24.179351 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:24.180808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:24.197339 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb62c5-6a29-4554-836d-9b3431983a99 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:24.255123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998397b-8dc4-4ad0-a853-ef1a2e61f29a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:24.260139 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:24.269696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.269696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.269696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] PATH_INFO: `/v3/projects/7e4ad67a98474cd19ae75e01a7eb8a7b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.269696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4ad67a98474cd19ae75e01a7eb8a7b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:24.270272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:24.270389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:24.270491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.270491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.270491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] PATH_INFO: `/v3/users/746b16e34abc42d389e2e3920c7e52b3` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.270491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=746b16e34abc42d389e2e3920c7e52b3)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:24.270491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:24.380520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:24.395761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4ad67a98474cd19ae75e01a7eb8a7b', 'request_id': 'req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.401219 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4ad67a98474cd19ae75e01a7eb8a7b', 'request_id': 'req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.473804 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4ad67a98474cd19ae75e01a7eb8a7b', 'request_id': 'req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.485893 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] The token cache is being invalidate because project 7e4ad67a98474cd19ae75e01a7eb8a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:24.486494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.487514 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-00d982f1-b3cf-40ea-88ba-75fb8fb45b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.488786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746b16e34abc42d389e2e3920c7e52b3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.489763 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1336/2654] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:24 2022] DELETE /identity/v3/projects/7e4ad67a98474cd19ae75e01a7eb8a7b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:24.490024 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746b16e34abc42d389e2e3920c7e52b3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.490830 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746b16e34abc42d389e2e3920c7e52b3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.494502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbebad-1ad0-4a98-8d1a-412f335fbdac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.494790 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbebad-1ad0-4a98-8d1a-412f335fbdac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.495160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbebad-1ad0-4a98-8d1a-412f335fbdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.503692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746b16e34abc42d389e2e3920c7e52b3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.511502 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-01bc97ec-44bb-4db6-8f78-246509384062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746b16e34abc42d389e2e3920c7e52b3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:24.516158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-06fbebad-1ad0-4a98-8d1a-412f335fbdac None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:24.517357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-06fbebad-1ad0-4a98-8d1a-412f335fbdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:24.577126 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1337/2655] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:24.585001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.585288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.585558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.589084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1319/2656] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:24 2022] DELETE /identity/v3/users/746b16e34abc42d389e2e3920c7e52b3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:24.593486 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.593777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.594055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.605013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:24.606209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:24.614323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:24.616138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:24.646098 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:24.667912 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1338/2657] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:24.672049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:24.678034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1320/2658] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:24.681955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ea6ce-863b-43bb-83f0-1a6ec93dff9d None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:24.687122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:24.687725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.688044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.688323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.689064 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:24.689784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:24.690994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:24.695739 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:24.697197 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:24.703783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1339/2659] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:57:24.708217 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:24.717865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60195738-4a5f-4716-8dbf-a87ef55ea29f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:24.722606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:24.723241 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.723522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.724467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.725103 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:24.726983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:24.758082 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb710c9-62ba-4289-b39b-b0e6805f9b5b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:24.761831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:24.762485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.762773 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.763055 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.772433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:24.773858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:24.783484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1321/2660] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:57:24.812680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1340/2661] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:24 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:57:24.816850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:24.827289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aed735-867c-4f19-8b66-be4870cf3084 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:24.886295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:24.886981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:24.887266 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:24.887540 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:24.888281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:24.890205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.017652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1322/2662] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:24 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:25.023350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:25.035361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d065e5-9d31-4ac6-a940-cf6317aa616f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:25.040933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:25.041730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.042081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.042421 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.043229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:25.044938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.055967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1341/2663] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:25.060148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:25.070288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3cea0-6b7f-47f3-9a7d-845b9030f0ea admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:25.074927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911e5cb-4fc7-4fae-b19b-f50341f263dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:25.075628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e5cb-4fc7-4fae-b19b-f50341f263dd admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.075854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e5cb-4fc7-4fae-b19b-f50341f263dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.076175 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911e5cb-4fc7-4fae-b19b-f50341f263dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.076898 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911e5cb-4fc7-4fae-b19b-f50341f263dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:25.078481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911e5cb-4fc7-4fae-b19b-f50341f263dd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.089954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1323/2664] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:25.094234 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:25.105131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e3661-41d9-42ad-a5d3-716b476cf67a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:25.110132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:25.111003 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.111282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.111557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] PATH_INFO: `/v3/projects/723de1fccafe47c2a65b3e48538b6abf/users/8cb18caccaa34cb4b1c4efe3aac4e5a6/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.120005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:25.126830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=723de1fccafe47c2a65b3e48538b6abf, user_id=8cb18caccaa34cb4b1c4efe3aac4e5a6, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:25.129777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.268746 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1342/2665] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:25 2022] PUT /identity/v3/projects/723de1fccafe47c2a65b3e48538b6abf/users/8cb18caccaa34cb4b1c4efe3aac4e5a6/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:25.284141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.284669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.284879 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.287346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:25.289346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:25.318368 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] MFA Rules not processed for user `8cb18caccaa34cb4b1c4efe3aac4e5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:25.319007 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:25.361162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82118b-4269-4742-b696-aabdc62472d5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:25.364164 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:25.366210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:25.367063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.367342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.367614 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] PATH_INFO: `/v3/projects/91b802ddb82b45a4a804c20070d30509` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.368843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b802ddb82b45a4a804c20070d30509)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:25.370818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.388601 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1324/2666] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:25.400595 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:25.402148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:25.457671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f6a2a-833b-4e9e-a748-12b2c9562397 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:25.464778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b802ddb82b45a4a804c20070d30509', 'request_id': 'req-aef3f6b8-bbd8-4e74-9794-11f9d6760834'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.470394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b802ddb82b45a4a804c20070d30509', 'request_id': 'req-aef3f6b8-bbd8-4e74-9794-11f9d6760834'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.507356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:25.508109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.508387 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.508659 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.542612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b802ddb82b45a4a804c20070d30509', 'request_id': 'req-aef3f6b8-bbd8-4e74-9794-11f9d6760834'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.555481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] The token cache is being invalidate because project 91b802ddb82b45a4a804c20070d30509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:25.555797 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.556492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.558110 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1343/2667] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:25 2022] DELETE /identity/v3/projects/91b802ddb82b45a4a804c20070d30509 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:25.562081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:25.565639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:25.565747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:25.566427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.576705 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1325/2668] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:57:25.635620 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f6b8-bbd8-4e74-9794-11f9d6760834 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:25.640409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:25.641278 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:25.641568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:25.641846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] PATH_INFO: `/v3/users/7b53137ef7d04eb9a364a24f2b18198a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:25.643062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b53137ef7d04eb9a364a24f2b18198a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:25.645042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:25.667464 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:25.870169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b53137ef7d04eb9a364a24f2b18198a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.870752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b53137ef7d04eb9a364a24f2b18198a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.871429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b53137ef7d04eb9a364a24f2b18198a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.887955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b53137ef7d04eb9a364a24f2b18198a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.894513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-41ee87e5-b645-4983-bf08-91b709b33dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b53137ef7d04eb9a364a24f2b18198a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:25.971104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1344/2669] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:25 2022] DELETE /identity/v3/users/7b53137ef7d04eb9a364a24f2b18198a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:26.653626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:26.667379 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72889fa7-c545-48c6-af3c-b4b2ded50d7b service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:26.726043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:26.733057 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:26.734901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:26.734901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:26.734901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] PATH_INFO: `/v3/projects/e1682d3c3e2b4e5b8305b84563b9ec69` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:26.735786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1682d3c3e2b4e5b8305b84563b9ec69)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:26.737698 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:26.845415 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1682d3c3e2b4e5b8305b84563b9ec69', 'request_id': 'req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:26.851022 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1682d3c3e2b4e5b8305b84563b9ec69', 'request_id': 'req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:26.857148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1682d3c3e2b4e5b8305b84563b9ec69', 'request_id': 'req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:26.930029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] The token cache is being invalidate because project e1682d3c3e2b4e5b8305b84563b9ec69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:26.930311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:26.930923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e2aa86ac-49d6-4532-b2e6-fc5eafaff41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:26.932490 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1326/2670] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:26 2022] DELETE /identity/v3/projects/e1682d3c3e2b4e5b8305b84563b9ec69 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:26.937386 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:26.937870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:26.937982 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:26.957740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:26.959600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:27.016793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1345/2671] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:27.025482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.025770 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.026053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.045619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:27.046835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:27.055039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1327/2672] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:27.059182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.069375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695bc01-dd23-4f9f-ac6b-5f7e5652b4f4 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.073974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.074643 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.074911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.075188 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.075909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:27.076243 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.077826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.089929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1346/2673] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:57:27.094152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.104247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9c123-7fe5-49af-9aaa-3cf010a85631 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.109196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.109870 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.110184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.110459 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.111160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.113117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.201401 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1328/2674] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:27 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:27.205557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.215477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af47f44-ecd3-43e2-bcf6-041e1c70aa50 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.272475 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.273148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.278995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.278995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.278995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.278995 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.381148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1347/2675] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:27 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:27.382626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.393484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737361d-2891-4ce2-9624-e9fb3c2c1293 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.398627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.399289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.399572 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.399847 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.400619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.402213 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.412544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1329/2676] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:27.416626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.426751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e353a6-8b5f-4078-b5a7-804dbce0421a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.432249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db07c7a-03e5-4267-a20b-0b017d44abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.432902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07c7a-03e5-4267-a20b-0b017d44abe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.433189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07c7a-03e5-4267-a20b-0b017d44abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.433466 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07c7a-03e5-4267-a20b-0b017d44abe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.434196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db07c7a-03e5-4267-a20b-0b017d44abe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.435781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db07c7a-03e5-4267-a20b-0b017d44abe3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.446477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1348/2677] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:27.450708 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.461536 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a652368-1ae9-4b9c-86fa-b18a4dc2cad3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.466802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.467736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.468052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.468332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] PATH_INFO: `/v3/projects/f948eb6eeb494370961d13d2c7343efe/users/dd2010dc4c6847c880c37cbd408f7a83/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.483137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f948eb6eeb494370961d13d2c7343efe, user_id=dd2010dc4c6847c880c37cbd408f7a83, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.485899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.611499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1330/2678] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:27 2022] PUT /identity/v3/projects/f948eb6eeb494370961d13d2c7343efe/users/dd2010dc4c6847c880c37cbd408f7a83/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:27.622755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.623044 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.623320 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.630832 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:27.651089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] MFA Rules not processed for user `dd2010dc4c6847c880c37cbd408f7a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:27.652356 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:27.717250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1349/2679] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:27.722025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.784642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9367-c1a6-43cd-9698-cfc2ef67a13f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.790003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.790663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.790950 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.791222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.791925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.795984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:27.892906 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1331/2680] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:27 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:27.897540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:27.908502 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004dd79-6a8a-4fb2-9293-251d1a359346 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:27.965529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:27.966196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:27.966462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:27.966734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:27.967492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:27.969420 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.051520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1350/2681] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:27 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:28.055654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.066300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70107b-eaa4-4b81-a307-a5b481df7877 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.071043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.071702 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.072023 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.072305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.073052 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.074624 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.075883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:28.086447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1332/2682] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:28.090443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.101185 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3774586-e1b4-4cf7-9b69-7e098f39bd16 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.105841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f107ab-de42-4d40-aefb-3b3bc1f6a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.106487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f107ab-de42-4d40-aefb-3b3bc1f6a8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.113016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f107ab-de42-4d40-aefb-3b3bc1f6a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.113016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f107ab-de42-4d40-aefb-3b3bc1f6a8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.113016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f107ab-de42-4d40-aefb-3b3bc1f6a8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.113016 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f107ab-de42-4d40-aefb-3b3bc1f6a8c1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.119655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1351/2683] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:28.123692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.134046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737ad00-ac5d-421f-af66-0cd1f1bb350c admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.138594 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.139462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.139744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.141672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] PATH_INFO: `/v3/projects/741448758ad34199b5ae1e9f136d453b/users/8ff654407fe64f10b30c263b1673520d/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.154854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=741448758ad34199b5ae1e9f136d453b, user_id=8ff654407fe64f10b30c263b1673520d, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.157446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.251547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1333/2684] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:28 2022] PUT /identity/v3/projects/741448758ad34199b5ae1e9f136d453b/users/8ff654407fe64f10b30c263b1673520d/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:28.263631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.263967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.264272 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.292449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] MFA Rules not processed for user `8ff654407fe64f10b30c263b1673520d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:28.293657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:28.354117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:28.357668 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1352/2685] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:28.362265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.424995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e0b10-99ed-4c44-bf98-ed6b5dfc0c5e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.429894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.430913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.431196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.431479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.432206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.434178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.538904 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1334/2686] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:28 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:28.542957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.554550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f2b96-d3d5-4e45-b615-66347dfce165 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.610473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.611131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.611412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.611683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.612404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.614302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.695189 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1353/2687] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:28 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:28.696374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.706768 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5ccd8-dd2f-40c8-b0d8-3d51635ed298 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.711337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.712029 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.712313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.712588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.713307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.714896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.725781 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1335/2688] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:28.729830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.740215 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d986bc1-fa55-4686-bbd3-f67f1763e349 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.744992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.745860 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.746141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.746447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] PATH_INFO: `/v3/projects/efe5c4fdc60e47d2aa2f0e5c795a3219/users/98aa71e8d68b4dbea1f1e888fbeb6d02/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.762313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe5c4fdc60e47d2aa2f0e5c795a3219, user_id=98aa71e8d68b4dbea1f1e888fbeb6d02, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.765011 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.857429 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1354/2689] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:28 2022] PUT /identity/v3/projects/efe5c4fdc60e47d2aa2f0e5c795a3219/users/98aa71e8d68b4dbea1f1e888fbeb6d02/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:28.861274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.871961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a68e4f-cef2-427c-90e9-586f2849ce78 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.932073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7363af-d944-4a45-b766-8d579424cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.932748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7363af-d944-4a45-b766-8d579424cb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.936434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7363af-d944-4a45-b766-8d579424cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.936434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7363af-d944-4a45-b766-8d579424cb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.936434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7363af-d944-4a45-b766-8d579424cb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.936434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7363af-d944-4a45-b766-8d579424cb93 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.946362 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1336/2690] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:28.950776 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:28.961454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a3d7b-5af5-46fb-b021-7122bf009a41 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:28.966171 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:28.967066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.967350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.967640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] PATH_INFO: `/v3/projects/efe5c4fdc60e47d2aa2f0e5c795a3219/users/98aa71e8d68b4dbea1f1e888fbeb6d02/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:28.969608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe5c4fdc60e47d2aa2f0e5c795a3219, user_id=98aa71e8d68b4dbea1f1e888fbeb6d02, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:28.972290 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:28.982768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1355/2691] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:28 2022] PUT /identity/v3/projects/efe5c4fdc60e47d2aa2f0e5c795a3219/users/98aa71e8d68b4dbea1f1e888fbeb6d02/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:28.993736 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:28.994050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:28.994311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:29.022548 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] MFA Rules not processed for user `98aa71e8d68b4dbea1f1e888fbeb6d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:29.024116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:29.055844 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:29.093538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1337/2692] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:29.105716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:29.107407 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:29.164992 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5dcc-79bc-4b63-8717-b1159fc4d3f3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:29.168727 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:29.169366 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:29.169648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:29.169959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:29.179717 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:29.181192 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:29.194820 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1356/2693] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:29.301256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:29.303492 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:29.315198 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d4c50-7657-4d10-bc80-7d4905c28563 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:29.318775 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3bf6d-73ad-42b4-8d38-832bb430493f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:29.319403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bf6d-73ad-42b4-8d38-832bb430493f service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:29.319682 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bf6d-73ad-42b4-8d38-832bb430493f service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:29.319982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bf6d-73ad-42b4-8d38-832bb430493f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:29.500848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bf6d-73ad-42b4-8d38-832bb430493f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:29.502350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bf6d-73ad-42b4-8d38-832bb430493f service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:29.511613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1338/2694] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:33.480102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:33.540383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:33.588211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589f0cb-fc85-40e6-be91-7260cbdf3512 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:33.592898 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:33.593777 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:33.594062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:33.594341 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] PATH_INFO: `/v3/users/dd2010dc4c6847c880c37cbd408f7a83` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:33.595557 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2010dc4c6847c880c37cbd408f7a83)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:33.597518 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:33.785119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2010dc4c6847c880c37cbd408f7a83'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:33.785846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2010dc4c6847c880c37cbd408f7a83'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:33.786433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2010dc4c6847c880c37cbd408f7a83'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:33.799392 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2010dc4c6847c880c37cbd408f7a83'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:33.806937 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2010dc4c6847c880c37cbd408f7a83'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:33.915211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1357/2695] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:33 2022] DELETE /identity/v3/users/dd2010dc4c6847c880c37cbd408f7a83 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:33.920020 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:33.920499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:33.920598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:33.969991 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:33.971207 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:34.029765 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1339/2696] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:34.040201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:34.041655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:34.113815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea5e13-0c4d-436a-8eee-127a83dfb65d admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:34.117590 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:34.118230 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:34.118509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:34.118782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:34.129457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:34.130953 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:34.141543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1358/2697] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:57:34.591558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:34.593786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:34.612463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c856-a1f0-4af4-9153-a7575fe73155 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:34.619326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:34.627675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:34.627675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:34.627675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] PATH_INFO: `/v3/projects/f948eb6eeb494370961d13d2c7343efe` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:34.627675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f948eb6eeb494370961d13d2c7343efe)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:34.627675 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:34.763499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:34.774364 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f948eb6eeb494370961d13d2c7343efe', 'request_id': 'req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:34.781398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f948eb6eeb494370961d13d2c7343efe', 'request_id': 'req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:34.788860 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f948eb6eeb494370961d13d2c7343efe', 'request_id': 'req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:34.890804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] The token cache is being invalidate because project f948eb6eeb494370961d13d2c7343efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:34.891528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:34.892204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:34.893766 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1340/2698] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:34 2022] DELETE /identity/v3/projects/f948eb6eeb494370961d13d2c7343efe => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:34.898132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:34.908687 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6542e5-68d9-4624-a28e-3c257bd3901c service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:34.925781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:34.966465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:34.967322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:34.967598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:34.967865 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] PATH_INFO: `/v3/users/8ff654407fe64f10b30c263b1673520d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:34.969111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff654407fe64f10b30c263b1673520d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:34.971015 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:35.191004 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff654407fe64f10b30c263b1673520d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.191583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff654407fe64f10b30c263b1673520d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.192211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff654407fe64f10b30c263b1673520d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.204116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff654407fe64f10b30c263b1673520d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.211714 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff654407fe64f10b30c263b1673520d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.331305 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1359/2699] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:34 2022] DELETE /identity/v3/users/8ff654407fe64f10b30c263b1673520d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:35.767267 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:35.769297 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:35.783515 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef0a3f-c6dc-4ffc-9a8c-9e57de1719dd admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:35.848258 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:35.849240 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:35.849580 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:35.849837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] PATH_INFO: `/v3/projects/741448758ad34199b5ae1e9f136d453b` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:35.851059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=741448758ad34199b5ae1e9f136d453b)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:35.852994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:35.949075 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741448758ad34199b5ae1e9f136d453b', 'request_id': 'req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.954533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741448758ad34199b5ae1e9f136d453b', 'request_id': 'req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:35.961852 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741448758ad34199b5ae1e9f136d453b', 'request_id': 'req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.234146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] The token cache is being invalidate because project 741448758ad34199b5ae1e9f136d453b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:36.234437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.235078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.236663 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1341/2700] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:35 2022] DELETE /identity/v3/projects/741448758ad34199b5ae1e9f136d453b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:36.240695 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:36.243400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:36.255564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f8c6d-b031-4f3e-8def-0930ce8497df admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:36.314835 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:36.315730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:36.316041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:36.316309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] PATH_INFO: `/v3/users/98aa71e8d68b4dbea1f1e888fbeb6d02` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:36.317492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98aa71e8d68b4dbea1f1e888fbeb6d02)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:36.319398 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:36.540901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:36.545966 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98aa71e8d68b4dbea1f1e888fbeb6d02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.546642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98aa71e8d68b4dbea1f1e888fbeb6d02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.547490 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98aa71e8d68b4dbea1f1e888fbeb6d02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.560242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98aa71e8d68b4dbea1f1e888fbeb6d02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.566852 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-b7021f83-62f1-40d8-a63f-10e6f628633e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98aa71e8d68b4dbea1f1e888fbeb6d02'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:36.651606 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1360/2701] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:36 2022] DELETE /identity/v3/users/98aa71e8d68b4dbea1f1e888fbeb6d02 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:37.070789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:37.075275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:37.084835 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9788ea-e90a-4d72-bf9d-8f5a54abc2d0 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:37.135897 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:37.144514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:37.145371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.145652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.145934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] PATH_INFO: `/v3/projects/efe5c4fdc60e47d2aa2f0e5c795a3219` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.147092 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe5c4fdc60e47d2aa2f0e5c795a3219)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:37.149894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:37.263384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe5c4fdc60e47d2aa2f0e5c795a3219', 'request_id': 'req-79abf6c2-2884-47d3-bfda-071fbf39b985'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:37.269006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe5c4fdc60e47d2aa2f0e5c795a3219', 'request_id': 'req-79abf6c2-2884-47d3-bfda-071fbf39b985'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:37.275093 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe5c4fdc60e47d2aa2f0e5c795a3219', 'request_id': 'req-79abf6c2-2884-47d3-bfda-071fbf39b985'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:37.371509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] The token cache is being invalidate because project efe5c4fdc60e47d2aa2f0e5c795a3219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:37.371714 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:37.372352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-79abf6c2-2884-47d3-bfda-071fbf39b985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:37.374234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1342/2702] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:37 2022] DELETE /identity/v3/projects/efe5c4fdc60e47d2aa2f0e5c795a3219 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:37.380508 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.380990 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.381104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.430602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:37.431944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:37.490712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1361/2703] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:37.499500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.511356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.511356 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.519541 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:37.520756 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:37.528553 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1343/2704] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:37.532823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:37.543442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbc297-f69e-43f9-8c9f-2a62c5bb0af5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:37.547908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:37.548588 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.548868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.549166 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.549918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:37.550223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:37.551932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:37.564236 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1362/2705] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:57:37.568820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:37.579564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfaf07-b69a-4c2d-ba94-11cb1eafcdb1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:37.584896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:37.586254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.586539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.586813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.587533 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:37.589525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:37.760523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1344/2706] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:37 2022] POST /identity/v3/projects => generated 359 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:37.761621 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:37.772066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c100a69-f044-47f7-bfba-e55a4cbf8df9 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:37.838172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:37.838172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.838172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.838172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.838656 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:37.838815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:37.972042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1363/2707] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:37 2022] POST /identity/v3/users => generated 280 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 12:57:37.976614 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:37.987033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03341756-6521-4818-92ae-6613bc9cc0d3 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:37.991500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:37.992787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:37.993031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:37.993308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:37.994032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:37.995627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:38.005951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1345/2708] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:38.010422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:38.021265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234e257-5880-40c1-bf0a-035946144b69 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:38.025993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbdf62-cdca-454b-a3a4-6720ecc6a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:38.026649 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbdf62-cdca-454b-a3a4-6720ecc6a2be admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:38.026940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbdf62-cdca-454b-a3a4-6720ecc6a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:38.027221 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbdf62-cdca-454b-a3a4-6720ecc6a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:38.028050 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbdf62-cdca-454b-a3a4-6720ecc6a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:38.031572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbdf62-cdca-454b-a3a4-6720ecc6a2be admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:38.035082 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:38.042078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1364/2709] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:38.045965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:38.057059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df719b36-6447-42ff-ac9b-ba3fcbc4c411 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:38.063152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:38.063152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:38.063152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:38.063152 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] PATH_INFO: `/v3/projects/27100c2d839c4455b87627e7cc3c5a31/users/287128f45f314938b7737f6470678136/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:38.077782 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27100c2d839c4455b87627e7cc3c5a31, user_id=287128f45f314938b7737f6470678136, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:38.080578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:38.177804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1346/2710] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:38 2022] PUT /identity/v3/projects/27100c2d839c4455b87627e7cc3c5a31/users/287128f45f314938b7737f6470678136/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:38.251616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:38.253422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:38.253422 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:38.280595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] MFA Rules not processed for user `287128f45f314938b7737f6470678136`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:38.281807 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:38.348214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1365/2711] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:38.387234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:38.388993 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:38.453199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b68e-be4b-4e0d-be84-737a040d178e admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:38.457256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9716-8717-42f9-bc8f-28042ddbca04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:38.457915 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9716-8717-42f9-bc8f-28042ddbca04 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:38.458248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9716-8717-42f9-bc8f-28042ddbca04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:38.458526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9716-8717-42f9-bc8f-28042ddbca04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:38.469220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9716-8717-42f9-bc8f-28042ddbca04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:38.472085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9716-8717-42f9-bc8f-28042ddbca04 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:38.481576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1347/2712] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:38 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:38.496789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:38.565391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32846b6d-87e0-4b5b-95b8-abb41e97ad2f None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:38.570170 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:38.571041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:38.571322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:38.571639 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] PATH_INFO: `/v3/users/287128f45f314938b7737f6470678136` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:38.572887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=287128f45f314938b7737f6470678136)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:38.574861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:38.807888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287128f45f314938b7737f6470678136'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:38.808497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287128f45f314938b7737f6470678136'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:38.809104 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287128f45f314938b7737f6470678136'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:38.821756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287128f45f314938b7737f6470678136'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:38.829069 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287128f45f314938b7737f6470678136'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:38.891474 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1366/2713] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:38 2022] DELETE /identity/v3/users/287128f45f314938b7737f6470678136 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:38.896477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:38.896761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:38.897031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:38.916951 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:38.918146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:38.935359 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:38.980336 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1348/2714] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:38.999346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:38.999346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:39.004277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:39.051708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543cb82-35ad-45ce-b175-dd3fa52fdb2e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:39.055318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597ccc0-a9ac-4319-a4e4-7f3a70333c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:39.055983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597ccc0-a9ac-4319-a4e4-7f3a70333c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:39.056270 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597ccc0-a9ac-4319-a4e4-7f3a70333c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:39.056545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597ccc0-a9ac-4319-a4e4-7f3a70333c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:39.065520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597ccc0-a9ac-4319-a4e4-7f3a70333c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:39.066975 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597ccc0-a9ac-4319-a4e4-7f3a70333c4b service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:39.077179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1367/2715] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:39.567935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:39.570661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:39.586691 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f072273-d72d-4546-8c5d-6e4e0983473b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:39.592918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:39.593761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:39.594047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:39.594324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] PATH_INFO: `/v3/projects/27100c2d839c4455b87627e7cc3c5a31` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:39.595571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27100c2d839c4455b87627e7cc3c5a31)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:39.597877 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:39.712857 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27100c2d839c4455b87627e7cc3c5a31', 'request_id': 'req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:39.718375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27100c2d839c4455b87627e7cc3c5a31', 'request_id': 'req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:39.724581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27100c2d839c4455b87627e7cc3c5a31', 'request_id': 'req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:39.793270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] The token cache is being invalidate because project 27100c2d839c4455b87627e7cc3c5a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:39.793557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:39.794174 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-89c761b0-2cb0-4a60-b0a3-3698d4e712f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:39.795706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1349/2716] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:39 2022] DELETE /identity/v3/projects/27100c2d839c4455b87627e7cc3c5a31 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:39.800670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:39.801175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:39.801296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:39.822350 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:39.823479 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:39.884067 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1368/2717] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:39.891730 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:39.898974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:39.898974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:39.911658 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:39.912895 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:39.921176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1350/2718] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:39.925331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:39.935840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab30f6-b3c3-4177-94b7-6ce8518110b5 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:39.940449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:39.941087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:39.941367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:39.941642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:39.942361 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:39.942690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:39.944300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:39.956651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1369/2719] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 12:57:39.961109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:39.970287 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e3f07-ed1d-4fa2-8a4c-cfb81f65f2b7 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:39.975111 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:39.975769 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:39.976395 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:39.976673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:39.977375 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:39.979320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.099241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1351/2720] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:39 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:40.103478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.114043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34004a7-d806-45c7-8315-1a92ecb658f1 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.168363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.169019 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.169300 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.169574 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.170254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.172169 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.320240 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1370/2721] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:40 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:40.324630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.335042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaecc1-3480-4efd-9be2-35e73cd068cd admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.340039 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.340833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.341251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.341617 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.342664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.344606 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.357191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1352/2722] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:40.361111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.372632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a918a69-74a0-45cd-94e0-23f9f6b53577 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.377457 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cbebd-b021-40f0-b997-b0511a1ba7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.378131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cbebd-b021-40f0-b997-b0511a1ba7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.378417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cbebd-b021-40f0-b997-b0511a1ba7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.378692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cbebd-b021-40f0-b997-b0511a1ba7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.379671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cbebd-b021-40f0-b997-b0511a1ba7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.381292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cbebd-b021-40f0-b997-b0511a1ba7b1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.391980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1371/2723] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:40.397450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.407690 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cabd3-9cea-4910-8eba-cad59bc849a4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.412324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.413226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.414003 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.414276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] PATH_INFO: `/v3/projects/2d6db8e2cbd54996967237adfc3a362b/users/1ee33db66c7e481980d19d598ce1ea16/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.428780 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6db8e2cbd54996967237adfc3a362b, user_id=1ee33db66c7e481980d19d598ce1ea16, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.432064 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.508584 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1353/2724] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:40 2022] PUT /identity/v3/projects/2d6db8e2cbd54996967237adfc3a362b/users/1ee33db66c7e481980d19d598ce1ea16/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:40.521627 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.521911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.522209 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.549438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] MFA Rules not processed for user `1ee33db66c7e481980d19d598ce1ea16`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:40.550662 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:40.556546 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:40.614655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1372/2725] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:40.619079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.665329 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:40.681997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec444bf-4db9-4336-889a-085b38521429 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.686588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.687245 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.687526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.687804 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.688535 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.690550 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.819094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1354/2726] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:40 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:40.822929 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.832479 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:40.834236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:40.837377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac359af-e487-451f-a2c8-d8762f2bbb10 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.895481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.896102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.896384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.896655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.897347 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.899802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:40.900593 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ab47-9246-4ead-99ba-bbcb37439ebb admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:40.905530 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:40.906399 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:40.906802 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:40.907089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] PATH_INFO: `/v3/users/8cb18caccaa34cb4b1c4efe3aac4e5a6` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:40.908324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb18caccaa34cb4b1c4efe3aac4e5a6)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:40.910231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.011834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1373/2727] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:40 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:41.016000 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.027587 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1816630-3c7c-4b78-a073-c1e5744f6854 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.032346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.033048 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.033387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.033710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.034468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.036200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.047036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1374/2728] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:41.050944 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.060673 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591755c-f8f9-4a57-8440-4b12356e7e13 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.065933 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.066791 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.067497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.067497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] PATH_INFO: `/v3/projects/39f325676fbc49b6a41aca01487eeed2/users/939f263deabb475da9048983f3471cf5/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.082702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f325676fbc49b6a41aca01487eeed2, user_id=939f263deabb475da9048983f3471cf5, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.086098 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.116009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb18caccaa34cb4b1c4efe3aac4e5a6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:41.116771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb18caccaa34cb4b1c4efe3aac4e5a6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:41.119275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb18caccaa34cb4b1c4efe3aac4e5a6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:41.129981 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb18caccaa34cb4b1c4efe3aac4e5a6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:41.137688 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-f9a4ec6c-3ffc-4ad7-b80c-596cf453bb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb18caccaa34cb4b1c4efe3aac4e5a6'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:41.218323 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1375/2729] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:41 2022] PUT /identity/v3/projects/39f325676fbc49b6a41aca01487eeed2/users/939f263deabb475da9048983f3471cf5/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:41.222135 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.223725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.229199 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1355/2730] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:40 2022] DELETE /identity/v3/users/8cb18caccaa34cb4b1c4efe3aac4e5a6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:41.233783 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.234071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.234352 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.254313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:41.256737 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.293684 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a6a9-323c-424c-8307-b1871721d34f admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.298388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:41.301117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:41.318447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1356/2731] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:41.328289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.329627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.352280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.353231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.353378 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.353666 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.354678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.356891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.366759 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1376/2732] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 12:57:41.371395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.382303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55471d-5e40-446e-8b42-a61a9248c7b3 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.387025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2221-fbc2-4d12-8245-df9a11f08788 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.391486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125909d9-2530-475b-81bb-658854acea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.391486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125909d9-2530-475b-81bb-658854acea65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.391486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125909d9-2530-475b-81bb-658854acea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.391486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125909d9-2530-475b-81bb-658854acea65 admin admin] PATH_INFO: `/v3/projects/39f325676fbc49b6a41aca01487eeed2/users/939f263deabb475da9048983f3471cf5/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.391891 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.392027 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125909d9-2530-475b-81bb-658854acea65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f325676fbc49b6a41aca01487eeed2, user_id=939f263deabb475da9048983f3471cf5, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.392124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.392124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.392124 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.393799 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125909d9-2530-475b-81bb-658854acea65 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.401956 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.403384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.405495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1377/2733] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:41 2022] PUT /identity/v3/projects/39f325676fbc49b6a41aca01487eeed2/users/939f263deabb475da9048983f3471cf5/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:41.413330 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1357/2734] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:57:41.418348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.419075 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.419358 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.448529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] MFA Rules not processed for user `939f263deabb475da9048983f3471cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:41.449737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.522117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1378/2735] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 12:57:41.533881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.535269 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.593921 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae345ae0-e5fd-4d8b-a0d0-57249d656119 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.650963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.651668 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.651997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.652314 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.654639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.740528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.742639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.747875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=100 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:41.752840 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1358/2736] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:41.870179 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:41.872211 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:41.943596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291733c-2df8-4af5-89cd-432069cde97e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:41.949522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:41.950391 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:41.950678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:41.950963 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] PATH_INFO: `/v3/projects/723de1fccafe47c2a65b3e48538b6abf` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:41.953005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=723de1fccafe47c2a65b3e48538b6abf)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:41.958257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:41.978690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:42.088438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723de1fccafe47c2a65b3e48538b6abf', 'request_id': 'req-e442e300-e2b6-4085-8c74-81b8a0e30a8b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:42.094353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723de1fccafe47c2a65b3e48538b6abf', 'request_id': 'req-e442e300-e2b6-4085-8c74-81b8a0e30a8b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:42.188428 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723de1fccafe47c2a65b3e48538b6abf', 'request_id': 'req-e442e300-e2b6-4085-8c74-81b8a0e30a8b'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:42.207572 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] The token cache is being invalidate because project 723de1fccafe47c2a65b3e48538b6abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:42.207868 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:42.208544 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-e442e300-e2b6-4085-8c74-81b8a0e30a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:42.210078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1379/2737] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:41 2022] DELETE /identity/v3/projects/723de1fccafe47c2a65b3e48538b6abf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 12:57:44.869155 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:44.880463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db113b6c-63cf-4cec-87a3-103d7a621aa3 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:44.938192 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:44.943858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:44.943858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:44.943858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] PATH_INFO: `/v3/users/1ee33db66c7e481980d19d598ce1ea16` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:44.943858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee33db66c7e481980d19d598ce1ea16)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:44.943858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:45.106528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee33db66c7e481980d19d598ce1ea16'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:45.107185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee33db66c7e481980d19d598ce1ea16'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:45.107790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee33db66c7e481980d19d598ce1ea16'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:45.121970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee33db66c7e481980d19d598ce1ea16'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:45.129468 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee33db66c7e481980d19d598ce1ea16'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:45.206132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1359/2738] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:44 2022] DELETE /identity/v3/users/1ee33db66c7e481980d19d598ce1ea16 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:45.211510 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41911-f889-48bb-8698-827396f20a49 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:45.211965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41911-f889-48bb-8698-827396f20a49 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:45.212146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f41911-f889-48bb-8698-827396f20a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:45.236384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-37f41911-f889-48bb-8698-827396f20a49 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:45.239444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-37f41911-f889-48bb-8698-827396f20a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:45.301748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1380/2739] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:45.312017 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:45.313483 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:45.370825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce1b6-a5c6-417d-be1a-a975e68ae060 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:45.374498 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:45.375162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:45.375446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:45.375749 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:45.385728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:45.387163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:45.396875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1360/2740] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:45.824815 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41911-f889-48bb-8698-827396f20a49 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:45.826310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-37f41911-f889-48bb-8698-827396f20a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:45.838946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f41911-f889-48bb-8698-827396f20a49 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:45.843509 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:45.844396 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:45.844669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:45.844961 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] PATH_INFO: `/v3/projects/2d6db8e2cbd54996967237adfc3a362b` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:45.853477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6db8e2cbd54996967237adfc3a362b)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:45.853477 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:45.961580 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6db8e2cbd54996967237adfc3a362b', 'request_id': 'req-05cc6155-431c-49fc-9098-eb8d522c6148'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:45.967190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6db8e2cbd54996967237adfc3a362b', 'request_id': 'req-05cc6155-431c-49fc-9098-eb8d522c6148'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.045712 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6db8e2cbd54996967237adfc3a362b', 'request_id': 'req-05cc6155-431c-49fc-9098-eb8d522c6148'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.057593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] The token cache is being invalidate because project 2d6db8e2cbd54996967237adfc3a362b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:46.057837 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.065448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.065448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1381/2741] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:45 2022] DELETE /identity/v3/projects/2d6db8e2cbd54996967237adfc3a362b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:46.065665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:46.074190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa335729-a3c4-4821-a6c8-d9cea4939775 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:46.092391 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:46.128687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:46.129813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:46.130094 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:46.130370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] PATH_INFO: `/v3/users/939f263deabb475da9048983f3471cf5` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:46.131557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=939f263deabb475da9048983f3471cf5)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:46.134211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:46.351429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939f263deabb475da9048983f3471cf5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.352066 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939f263deabb475da9048983f3471cf5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.352900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939f263deabb475da9048983f3471cf5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.364679 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939f263deabb475da9048983f3471cf5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.372462 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-92fd76a1-1964-4c57-91b1-c6625450a45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939f263deabb475da9048983f3471cf5'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:46.452289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1361/2742] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:57:46 2022] DELETE /identity/v3/users/939f263deabb475da9048983f3471cf5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:46.830454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:46.832550 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:46.846764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc6155-431c-49fc-9098-eb8d522c6148 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:46.877816 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:46.904897 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:46.905813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:46.906089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:46.906355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] PATH_INFO: `/v3/projects/39f325676fbc49b6a41aca01487eeed2` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:46.907528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f325676fbc49b6a41aca01487eeed2)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:46.909448 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.040148 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f325676fbc49b6a41aca01487eeed2', 'request_id': 'req-8efbc857-60af-4f23-aacf-70a26ca64398'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:47.045956 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f325676fbc49b6a41aca01487eeed2', 'request_id': 'req-8efbc857-60af-4f23-aacf-70a26ca64398'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:47.119692 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f325676fbc49b6a41aca01487eeed2', 'request_id': 'req-8efbc857-60af-4f23-aacf-70a26ca64398'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:47.131689 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] The token cache is being invalidate because project 39f325676fbc49b6a41aca01487eeed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:57:47.131911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:47.133163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-8efbc857-60af-4f23-aacf-70a26ca64398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:57:47.134704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1382/2743] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:57:46 2022] DELETE /identity/v3/projects/39f325676fbc49b6a41aca01487eeed2 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:47.139523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.140026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.140137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.159342 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:47.160558 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:47.218920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1362/2744] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:47.226768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.227057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.227338 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.247255 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:47.248488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:47.256881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1383/2745] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:47.261134 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.270774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43428e02-3c96-44cb-af72-74484acdfbaa None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:47.276132 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:47.276789 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.277671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.277671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.278050 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 12:57:47.278357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:47.279970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.292918 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1363/2746] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 12:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 12:57:47.297288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.306950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc94ea-4412-4867-b8c2-e6f27bb0b58a None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:47.311665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:47.312365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.312640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.312914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.313608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:47.315499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.425119 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1384/2747] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 12:57:47 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:47.429467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.439313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c466-5d01-4728-8ad0-6186d8d1dbcf admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:47.467452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:47.498986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:47.500434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.500434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.500434 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.500931 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:47.502837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.624890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1364/2748] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 12:57:47 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 12:57:47.628999 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.640562 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04114780-3166-42d3-95dc-5dfecae359a5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:47.645294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:47.645940 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.646226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.646498 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.647357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:47.649299 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.660844 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1385/2749] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:47.665678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.677701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ce1f-5b7c-4ee1-95c2-db51ed25d2ef admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:47.684823 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcba94f-2d6b-498e-9c2f-bd26a0ab2003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:47.685826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcba94f-2d6b-498e-9c2f-bd26a0ab2003 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.686109 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcba94f-2d6b-498e-9c2f-bd26a0ab2003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.686382 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcba94f-2d6b-498e-9c2f-bd26a0ab2003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.687171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcba94f-2d6b-498e-9c2f-bd26a0ab2003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:47.688811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcba94f-2d6b-498e-9c2f-bd26a0ab2003 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.703936 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1365/2750] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 12:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 12:57:47.709049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.720876 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b9a9b-b4b5-4e88-9a77-65ba14e79833 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:47.728264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:47.729744 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.730226 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.730700 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] PATH_INFO: `/v3/projects/dacda3113ab0401ea2a77a8367cbb0d6/users/a162289e56a441508eb86a8d446b41ca/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.748599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacda3113ab0401ea2a77a8367cbb0d6, user_id=a162289e56a441508eb86a8d446b41ca, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:47.751265 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:47.824389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1386/2751] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 12:57:47 2022] PUT /identity/v3/projects/dacda3113ab0401ea2a77a8367cbb0d6/users/a162289e56a441508eb86a8d446b41ca/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:57:47.839611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:47.839899 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:47.840203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:47.875274 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] MFA Rules not processed for user `a162289e56a441508eb86a8d446b41ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:47.877203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:47.943209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1366/2752] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:47.954917 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:47.956808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:48.020918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b1a3-a710-4211-875a-e58f868eae32 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:48.024743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0d54d-1c7c-4226-978c-520ffeece5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:48.025401 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0d54d-1c7c-4226-978c-520ffeece5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:48.025681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0d54d-1c7c-4226-978c-520ffeece5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:48.025955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0d54d-1c7c-4226-978c-520ffeece5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:48.034455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0d54d-1c7c-4226-978c-520ffeece5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:48.035986 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0d54d-1c7c-4226-978c-520ffeece5a1 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:48.040823 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:48.046061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1387/2753] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:49.080871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:57:49.082366 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:49.175190 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052f5eb-877d-4fac-a612-daab1fd205a1 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:57:49.180833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:57:49.181518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:49.181797 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:49.182071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:49.184047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:49.196076 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:57:49.197647 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c6649-b502-4907-9430-35d6dc291f86 service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:57:49.208031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1367/2754] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:57:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:57:49.732928 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:57:49.733495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:57:49.733495 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:57:49.752049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] MFA Rules not processed for user `a162289e56a441508eb86a8d446b41ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:57:49.753259 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:57:49.761055 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1388/2755] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:57:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:57:59.203799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:57:59.746702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:07.228526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc216-1e34-47cd-9585-59a3620ade13 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:07.228526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc216-1e34-47cd-9585-59a3620ade13 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:07.228526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bc216-1e34-47cd-9585-59a3620ade13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:07.257643 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-0f0bc216-1e34-47cd-9585-59a3620ade13 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:07.264100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0f0bc216-1e34-47cd-9585-59a3620ade13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:07.319326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1368/2756] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:07.523834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:07.525829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:07.596492 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5832366-164b-41af-9c66-4b204c79f6eb None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:07.601513 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:07.602163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:07.603417 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:07.603696 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:07.611713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:07.613812 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:07.622237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1389/2757] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:08.419794 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783227b-9510-4dde-8198-28f1dfb9b9cf None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:08.420322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783227b-9510-4dde-8198-28f1dfb9b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:08.420424 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783227b-9510-4dde-8198-28f1dfb9b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:08.439734 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a783227b-9510-4dde-8198-28f1dfb9b9cf None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:08.440962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a783227b-9510-4dde-8198-28f1dfb9b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:08.448220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1369/2758] 10.222.0.45 () {58 vars in 967 bytes} [Mon Jul 25 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:08.460896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:08.472375 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266c3d9-56f5-4336-9b8a-3d7d9b2175f8 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:08.478113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:08.478932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:08.479214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:08.479488 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:08.487595 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:08.489201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:08.497985 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1390/2759] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:09.112656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bad86-399a-4d95-834c-1cd4182ca2c3 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:09.112944 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bad86-399a-4d95-834c-1cd4182ca2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:09.113219 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bad86-399a-4d95-834c-1cd4182ca2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:09.133557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-5c6bad86-399a-4d95-834c-1cd4182ca2c3 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:09.134747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5c6bad86-399a-4d95-834c-1cd4182ca2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:09.143484 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1370/2760] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:09.156404 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:09.167686 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33add3-12c9-4b97-b33d-0479c634d0f0 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:09.172761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:09.173387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:09.173670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:09.173948 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:09.182157 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:09.183722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:09.191787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1391/2761] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:09.808674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edc963-9392-4f09-9382-44bae165250e None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:09.809181 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edc963-9392-4f09-9382-44bae165250e None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:09.809319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edc963-9392-4f09-9382-44bae165250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:09.829202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-67edc963-9392-4f09-9382-44bae165250e None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:09.830427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-67edc963-9392-4f09-9382-44bae165250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:09.838759 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1371/2762] 10.222.0.45 () {58 vars in 967 bytes} [Mon Jul 25 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:09.851246 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:09.861908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676e5f6-b6d5-4c7d-8bc6-4fd6f45db838 service swift] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:09.866891 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ca3f4-d30c-4a16-b69a-ba63604468fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:09.867520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ca3f4-d30c-4a16-b69a-ba63604468fe service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:09.867800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ca3f4-d30c-4a16-b69a-ba63604468fe service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:09.868102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ca3f4-d30c-4a16-b69a-ba63604468fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:09.877231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ca3f4-d30c-4a16-b69a-ba63604468fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:09.878784 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ca3f4-d30c-4a16-b69a-ba63604468fe service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:09.888449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1392/2763] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:12.521077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edc963-9392-4f09-9382-44bae165250e None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:12.584209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edc963-9392-4f09-9382-44bae165250e None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:12.589592 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:12.590457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:12.590741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:12.591016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] PATH_INFO: `/v3/users/a162289e56a441508eb86a8d446b41ca` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:12.592237 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] RBAC: Authorizing `identity:delete_user(user_id=a162289e56a441508eb86a8d446b41ca)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:12.594191 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:12.825136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a162289e56a441508eb86a8d446b41ca'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:12.825712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a162289e56a441508eb86a8d446b41ca'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:12.826326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a162289e56a441508eb86a8d446b41ca'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:12.839275 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a162289e56a441508eb86a8d446b41ca'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:12.844478 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:12.846363 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a162289e56a441508eb86a8d446b41ca'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:12.908104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1372/2764] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 12:58:12 2022] DELETE /identity/v3/users/a162289e56a441508eb86a8d446b41ca => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:58:12.912740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:12.917952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:12.917952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:12.932078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:12.933268 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:12.992367 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1393/2765] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:13.002087 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:13.003494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:13.080982 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328f54f-33f7-45df-94e7-8842ef324def admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:13.084517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1984f-a77b-462f-902e-729272b3cda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:13.085161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1984f-a77b-462f-902e-729272b3cda7 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:13.085447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1984f-a77b-462f-902e-729272b3cda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:13.085725 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1984f-a77b-462f-902e-729272b3cda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:13.095292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1984f-a77b-462f-902e-729272b3cda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:13.096750 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1984f-a77b-462f-902e-729272b3cda7 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:13.106226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1373/2766] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:58:13.327655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:13.329283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:13.342172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653b6d-1c38-4371-b3e9-2668260168d1 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:13.348434 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:13.349303 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:13.349591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:13.349980 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] PATH_INFO: `/v3/projects/dacda3113ab0401ea2a77a8367cbb0d6` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:13.351683 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacda3113ab0401ea2a77a8367cbb0d6)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:13.355102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:13.451090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:13.454061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacda3113ab0401ea2a77a8367cbb0d6', 'request_id': 'req-04c9e792-1fc6-4c7f-a032-4283f28cc2df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:13.459486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacda3113ab0401ea2a77a8367cbb0d6', 'request_id': 'req-04c9e792-1fc6-4c7f-a032-4283f28cc2df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:13.548873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacda3113ab0401ea2a77a8367cbb0d6', 'request_id': 'req-04c9e792-1fc6-4c7f-a032-4283f28cc2df'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:13.561615 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] The token cache is being invalidate because project dacda3113ab0401ea2a77a8367cbb0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 12:58:13.561930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:13.562611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 12:58:13.564296 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1394/2767] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 12:58:13 2022] DELETE /identity/v3/projects/dacda3113ab0401ea2a77a8367cbb0d6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 12:58:17.842896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1cde-6367-4faa-b047-bc5a1b1c7c45 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:17.843376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1cde-6367-4faa-b047-bc5a1b1c7c45 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:17.843591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1cde-6367-4faa-b047-bc5a1b1c7c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:17.862946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-affd1cde-6367-4faa-b047-bc5a1b1c7c45 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:17.864223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-affd1cde-6367-4faa-b047-bc5a1b1c7c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:17.919499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1374/2768] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:17.931408 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:17.933491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:18.002753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9e792-1fc6-4c7f-a032-4283f28cc2df admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:18.008051 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a287cf5-a03f-488f-a2a6-5cb4eca59385 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:18.008691 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a287cf5-a03f-488f-a2a6-5cb4eca59385 service swift] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:18.008976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a287cf5-a03f-488f-a2a6-5cb4eca59385 service swift] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:18.009254 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a287cf5-a03f-488f-a2a6-5cb4eca59385 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:18.018158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a287cf5-a03f-488f-a2a6-5cb4eca59385 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:18.019730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a287cf5-a03f-488f-a2a6-5cb4eca59385 service swift] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:18.027674 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1395/2769] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:58:27.912711 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=63,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:28.024528 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:DELETE=4,keystone:SELECT=39,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:35.448251 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3f67-345b-435a-8d97-0f1f54274e93 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:35.455154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3f67-345b-435a-8d97-0f1f54274e93 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:35.455154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab3f67-345b-435a-8d97-0f1f54274e93 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:35.455154 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1375/2770] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:58:35.456441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44027-a639-42b4-bf41-cebfd07fe594 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:35.456873 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44027-a639-42b4-bf41-cebfd07fe594 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:35.457176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f44027-a639-42b4-bf41-cebfd07fe594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:35.492162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e3f44027-a639-42b4-bf41-cebfd07fe594 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:35.493382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e3f44027-a639-42b4-bf41-cebfd07fe594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:35.572141 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1396/2771] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:35.583664 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3f67-345b-435a-8d97-0f1f54274e93 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:35.585576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-64ab3f67-345b-435a-8d97-0f1f54274e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:35.648848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab3f67-345b-435a-8d97-0f1f54274e93 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:35.652433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a07c8a-68ee-4c85-92f1-9be9f07ba19f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:35.653069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a07c8a-68ee-4c85-92f1-9be9f07ba19f service glance] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:35.653350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a07c8a-68ee-4c85-92f1-9be9f07ba19f service glance] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:35.653621 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a07c8a-68ee-4c85-92f1-9be9f07ba19f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:35.663556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a07c8a-68ee-4c85-92f1-9be9f07ba19f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:35.665006 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a07c8a-68ee-4c85-92f1-9be9f07ba19f service glance] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:35.676499 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1376/2772] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:58:35.962311 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d0d3-ed71-4731-bf67-2c473af90c33 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:35.962583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d0d3-ed71-4731-bf67-2c473af90c33 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:35.963592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33d0d3-ed71-4731-bf67-2c473af90c33 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:35.965024 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1397/2773] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:58:35.969927 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e704b-6631-4c98-bea7-8e1a17b1aaeb None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:35.974305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e704b-6631-4c98-bea7-8e1a17b1aaeb None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:35.974305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e704b-6631-4c98-bea7-8e1a17b1aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:35.991172 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9e3e704b-6631-4c98-bea7-8e1a17b1aaeb None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:35.992628 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9e3e704b-6631-4c98-bea7-8e1a17b1aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:36.044212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1377/2774] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:36.058427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d0d3-ed71-4731-bf67-2c473af90c33 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:36.060537 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5c33d0d3-ed71-4731-bf67-2c473af90c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:36.074485 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33d0d3-ed71-4731-bf67-2c473af90c33 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:36.077973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28759007-3f91-443c-9920-8ce596469018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:36.078604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759007-3f91-443c-9920-8ce596469018 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:36.078890 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759007-3f91-443c-9920-8ce596469018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:36.079168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28759007-3f91-443c-9920-8ce596469018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:36.086274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759007-3f91-443c-9920-8ce596469018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:36.088357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28759007-3f91-443c-9920-8ce596469018 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:36.098426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1398/2775] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 12:58:36.183117 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ce8c-7ed8-4863-8be4-880908b81a45 None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:36.183411 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ce8c-7ed8-4863-8be4-880908b81a45 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:36.183689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ce8c-7ed8-4863-8be4-880908b81a45 None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:36.185146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1378/2776] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 12:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 12:58:36.190423 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5c1b-7499-4e09-9420-481351c8ab96 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:36.190716 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5c1b-7499-4e09-9420-481351c8ab96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:36.190994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5c1b-7499-4e09-9420-481351c8ab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:36.211360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-75fa5c1b-7499-4e09-9420-481351c8ab96 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:36.212735 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-75fa5c1b-7499-4e09-9420-481351c8ab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:36.222994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1399/2777] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:36.233697 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ce8c-7ed8-4863-8be4-880908b81a45 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:36.244995 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ce8c-7ed8-4863-8be4-880908b81a45 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:36.248626 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:36.249263 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:36.249546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:36.249825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:36.261037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:36.262470 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:36.273183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1379/2778] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:58:39.675132 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703028-d556-4ba5-bd73-3d25b8dbdd96 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:39.675697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703028-d556-4ba5-bd73-3d25b8dbdd96 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:39.675697 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703028-d556-4ba5-bd73-3d25b8dbdd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:39.696626 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c5703028-d556-4ba5-bd73-3d25b8dbdd96 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:39.697942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c5703028-d556-4ba5-bd73-3d25b8dbdd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:39.706035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1400/2779] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:39.719222 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:39.731291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c187-b5cf-49da-99bd-30206dd8e67b service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:39.736320 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:39.737008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:39.737236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:39.737508 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:39.745947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:39.747556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:39.756224 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1380/2780] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 12:58:49.690225 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=52 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:49.752660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=61 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:58:57.376284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e11b-d34e-4b72-b769-b8ac4b774b38 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:57.376284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e11b-d34e-4b72-b769-b8ac4b774b38 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:57.376284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e11b-d34e-4b72-b769-b8ac4b774b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:57.397424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-13d3e11b-d34e-4b72-b769-b8ac4b774b38 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:58:57.398677 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-13d3e11b-d34e-4b72-b769-b8ac4b774b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:58:57.406214 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1401/2781] 10.222.0.45 () {58 vars in 967 bytes} [Mon Jul 25 12:58:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:58:57.420259 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:58:57.431771 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4855a51-dee0-46d7-a90a-44d79be012da service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:58:57.437146 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:58:57.437779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:58:57.449467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:58:57.449467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:58:57.449467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:58:57.449467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:58:57.457650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1381/2782] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 12:58:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 12:59:07.391010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:07.454044 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=6 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:43.306081 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:59:43.306628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:59:43.306734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:59:43.326205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] MFA Rules not processed for user `b50d7411c500419c92e18dd0e22be87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 12:59:43.327409 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:59:43.381440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1402/2783] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 12:59:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 12:59:44.072261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:59:44.081816 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112f98-c3d3-42da-9d61-4362a6a99d14 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:59:44.085557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:59:44.087205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:59:44.087205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:59:44.087205 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:59:44.088544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:59:44.103293 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:59:44.104885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:59:44.117348 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1382/2784] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:59:47.461788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 12:59:47.473611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19361eb1-8366-4b59-bfde-d9e4b7819e63 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 12:59:47.477842 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 12:59:47.478501 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 12:59:47.478782 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 12:59:47.479260 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 12:59:47.481440 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 12:59:47.498720 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 12:59:47.500647 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096cc65-bd8a-4dbe-aa1f-78b8ba1e6bc3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 12:59:47.516107 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1403/2785] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 12:59:54.111656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=6 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 12:59:57.508859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=31 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:00:45.661137 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:00:45.662612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:00:45.673888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f31af5-e1c8-4615-8ca2-9c247d23bf70 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:00:45.677422 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:00:45.678054 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:00:45.678337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:00:45.678609 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:00:45.680345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:00:45.690563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:00:45.692013 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:00:45.700299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1383/2786] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:00:50.458413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:00:50.459005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:00:50.459005 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:00:50.510616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:00:50.512267 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:00:50.529949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1404/2787] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:00:50.683529 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:00:50.706169 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2136a-0273-4033-8631-66565e988748 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:00:50.711431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:00:50.712121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:00:50.712403 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:00:50.712703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:00:50.722863 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:00:50.724585 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:00:50.733299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1384/2788] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 13:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 13:00:51.353846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:00:51.356983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:00:51.376896 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3a030-2e31-42d8-977d-5777334f9895 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:00:51.385870 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:00:51.387346 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:00:51.387715 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:00:51.388062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:00:51.401454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:00:51.421946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:00:51.423558 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caeecd9-223b-4575-9bd0-366bee4a770d service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:00:51.439334 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1405/2789] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:01:00.729418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=16 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:01.433609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=24 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:09.967096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:01:09.968514 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:01:10.035885 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74053b-c2d7-42e1-9b2c-db58801647e6 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:01:10.040718 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:01:10.041358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:01:10.041639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:01:10.041913 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:01:10.043819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:01:10.054952 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:01:10.056545 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:01:10.066338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1385/2790] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:01:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:01:15.228880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b38e-9b27-40a6-b3d6-cfcd42f83416 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:01:15.229389 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b38e-9b27-40a6-b3d6-cfcd42f83416 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:01:15.229487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0b38e-9b27-40a6-b3d6-cfcd42f83416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:01:15.249063 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-98a0b38e-9b27-40a6-b3d6-cfcd42f83416 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:01:15.250252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-98a0b38e-9b27-40a6-b3d6-cfcd42f83416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:01:15.257814 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1406/2791] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:01:15.270848 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:01:15.283247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0d9f-b11e-478a-8cb8-caccbe917a14 service placement] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:01:15.288298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:01:15.288934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:01:15.289223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:01:15.289507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:01:15.298008 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:01:15.299518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:01:15.307518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1386/2792] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 13:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 13:01:25.244309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:25.304331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=38 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:31.744503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:01:31.745006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:01:31.745117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:01:31.765329 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:01:31.766581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:01:31.774023 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1407/2793] 10.222.0.45 () {58 vars in 967 bytes} [Mon Jul 25 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:01:31.786332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:01:31.797048 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76da48-6b5c-4b0f-9a34-e3c52aef4212 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:01:31.802878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:01:31.803517 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:01:31.803803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:01:31.804122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:01:31.812309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:01:31.813966 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:01:31.822871 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1387/2794] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 13:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 13:01:41.759877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:01:41.819474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=6 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:06.863031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:06.864494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:06.941957 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574da09-463d-4811-9bdf-368c54eb66e8 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:06.945723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:06.946309 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:06.946596 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:06.946872 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:06.948681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:06.959798 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:06.961249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:06.971020 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1408/2795] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:10.007489 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:10.008942 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:10.025635 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18622e20-f1eb-4292-b613-8d380ecc81c6 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:10.031104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:10.031754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:10.032071 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:10.032450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:10.034210 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:10.047354 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:10.048983 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:10.061523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1388/2796] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:14.626854 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:14.636884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33053b-49f9-4c09-acb5-5f057b339b7f service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:14.640520 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:14.641405 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:14.642196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:14.642470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:14.644264 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:14.707397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:14.708889 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:14.718430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1409/2797] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:18.235634 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:18.251723 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df35093-9eeb-4b2f-91d6-64fc19f1a5d1 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:18.257331 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:18.257986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:18.258272 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:18.258551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:18.260825 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:18.273803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:18.275619 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:18.287161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1389/2798] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:18.360057 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:18.361678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:18.375442 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edaba5-fe3a-41fe-8833-980e263346a0 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:18.381013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:18.381967 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:18.382237 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:18.382512 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] PATH_INFO: `/v3/users/b50d7411c500419c92e18dd0e22be87a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:18.383884 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50d7411c500419c92e18dd0e22be87a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:18.389652 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:18.567400 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50d7411c500419c92e18dd0e22be87a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:18.568060 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50d7411c500419c92e18dd0e22be87a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:18.568726 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50d7411c500419c92e18dd0e22be87a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:18.580570 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50d7411c500419c92e18dd0e22be87a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:18.585863 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:18.587685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4f08e037-a1e6-4108-8942-db90adda5db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50d7411c500419c92e18dd0e22be87a'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:18.684875 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1410/2799] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:02:18 2022] DELETE /identity/v3/users/b50d7411c500419c92e18dd0e22be87a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:18.938257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:18.949525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3a84b-3d2d-45a9-b86d-6ade0a5a839b service placement] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.007290 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.008185 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.008474 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.008754 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] PATH_INFO: `/v3/projects/a75b2bfcc3e14b92bf49fbaa2a641d52` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.010233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75b2bfcc3e14b92bf49fbaa2a641d52)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.012162 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.152428 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75b2bfcc3e14b92bf49fbaa2a641d52', 'request_id': 'req-55096551-12ff-481e-863b-db84d7288f98'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:19.158485 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75b2bfcc3e14b92bf49fbaa2a641d52', 'request_id': 'req-55096551-12ff-481e-863b-db84d7288f98'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:19.164613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75b2bfcc3e14b92bf49fbaa2a641d52', 'request_id': 'req-55096551-12ff-481e-863b-db84d7288f98'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:19.231488 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] The token cache is being invalidate because project a75b2bfcc3e14b92bf49fbaa2a641d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:02:19.231777 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:19.232457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-55096551-12ff-481e-863b-db84d7288f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:19.233952 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1390/2800] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:02:18 2022] DELETE /identity/v3/projects/a75b2bfcc3e14b92bf49fbaa2a641d52 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:19.239468 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.239789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.244071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.259753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:19.261242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:19.320121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1411/2801] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:19.329208 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.329701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.329803 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.349790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:19.350974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:19.358925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1391/2802] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:19.363200 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:19.373175 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f3bd2-00d3-4154-8400-0429ad39f17b None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.377733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.378374 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.378655 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.378926 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.379641 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 13:02:19.379965 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.381545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.393605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1412/2803] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 13:02:19.397855 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:19.407560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82f80b-6fa9-4b38-bd70-96c938e63773 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.412421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.413077 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.413341 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.413613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.414306 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.416203 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.515078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1392/2804] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:02:19 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:19.519581 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:19.529503 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74b189-0486-4b8d-a7db-2d5b3633f529 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.587535 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.588223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.588575 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.588846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.589538 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.591426 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.667158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1413/2805] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:02:19 2022] POST /identity/v3/users => generated 279 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:19.671308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:19.681853 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029987d-5609-4982-be8a-22f3300548b4 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.686630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.687791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.688209 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.688491 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.689226 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.690836 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.701255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1393/2806] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:02:19.706026 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:19.716123 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e66754-0398-4813-a90f-ce903c032091 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.720802 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b05ee-5cb1-4539-bc2f-1bd7420d06ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.721455 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b05ee-5cb1-4539-bc2f-1bd7420d06ee admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.721733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b05ee-5cb1-4539-bc2f-1bd7420d06ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.722007 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b05ee-5cb1-4539-bc2f-1bd7420d06ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.722723 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b05ee-5cb1-4539-bc2f-1bd7420d06ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.724348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b05ee-5cb1-4539-bc2f-1bd7420d06ee admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.734087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1414/2807] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:02:19.738313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:19.748463 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d829c-a5a9-4ca8-968e-8eb4b450449d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:19.753733 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:19.754603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.754884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.755160 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] PATH_INFO: `/v3/projects/7b63126fd5a24dad9a09bccfb2956f46/users/ac64da378d5f4d59ada565063d275364/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.768831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:19.771760 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b63126fd5a24dad9a09bccfb2956f46, user_id=ac64da378d5f4d59ada565063d275364, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:19.774445 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:19.867349 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1394/2808] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:02:19 2022] PUT /identity/v3/projects/7b63126fd5a24dad9a09bccfb2956f46/users/ac64da378d5f4d59ada565063d275364/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 13:02:19.931292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:19.931582 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:19.931861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:19.959993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] MFA Rules not processed for user `ac64da378d5f4d59ada565063d275364`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:19.961195 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:20.003748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:20.025292 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1415/2809] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 13:02:20.028178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.090761 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fffd81-bdc6-4638-b5c1-5c1c991778c8 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.095500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.096433 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.096716 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.097049 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.097741 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.099630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.210882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1395/2810] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:02:20 2022] POST /identity/v3/projects => generated 357 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 13:02:20.215001 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.225888 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb2e83-c3f3-4462-af7b-6a3843427314 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.281690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.282274 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.282554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.282826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.283659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.285591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.393603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1416/2811] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:02:20 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:20.397611 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.408809 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069490-68f7-4740-a086-5184f441aaa9 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.413742 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.414405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.414687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.415010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.415744 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.417393 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.428678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1396/2812] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:02:20.432858 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.443242 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a4950-9a76-438c-8dc1-e7a1d4705333 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.450540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.450540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.450540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.450540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] PATH_INFO: `/v3/projects/fcd7b2cdfd624b9b9e0186bdf11278c2/users/aa348abc0fc74cbaa7c4c900f7807ec7/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.464205 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd7b2cdfd624b9b9e0186bdf11278c2, user_id=aa348abc0fc74cbaa7c4c900f7807ec7, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.466859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.564543 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1417/2813] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:02:20 2022] PUT /identity/v3/projects/fcd7b2cdfd624b9b9e0186bdf11278c2/users/aa348abc0fc74cbaa7c4c900f7807ec7/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:20.568427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.578701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56edd28-20ff-4ce8-a10c-727b08a98302 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.634357 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995be2c6-d300-4821-b722-1d29c0b1b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.635262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be2c6-d300-4821-b722-1d29c0b1b5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.635557 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be2c6-d300-4821-b722-1d29c0b1b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.635819 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995be2c6-d300-4821-b722-1d29c0b1b5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.636566 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995be2c6-d300-4821-b722-1d29c0b1b5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.638141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995be2c6-d300-4821-b722-1d29c0b1b5a7 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.647571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1397/2814] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 13:02:20.651704 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.662424 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20392add-6afe-47fc-b5e0-d5634d3e417e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.666994 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.667861 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.668172 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.668447 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] PATH_INFO: `/v3/projects/fcd7b2cdfd624b9b9e0186bdf11278c2/users/aa348abc0fc74cbaa7c4c900f7807ec7/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.670412 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd7b2cdfd624b9b9e0186bdf11278c2, user_id=aa348abc0fc74cbaa7c4c900f7807ec7, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.673078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.683821 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1418/2815] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:02:20 2022] PUT /identity/v3/projects/fcd7b2cdfd624b9b9e0186bdf11278c2/users/aa348abc0fc74cbaa7c4c900f7807ec7/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:20.693798 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.694084 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.694358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.722472 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] MFA Rules not processed for user `aa348abc0fc74cbaa7c4c900f7807ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:20.723669 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:20.769666 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:20.790032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1398/2816] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:20.801289 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:20.802974 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:20.859383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acadc1-3d5a-4fca-9421-ece04418e190 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:20.862895 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:20.863523 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:20.863803 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:20.864117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:20.873017 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:20.874449 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:20.883710 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1419/2817] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:21.109900 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:21.119646 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47fb49-c8c6-4a72-87b2-6d8a3b73702f None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:21.123291 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b573f-de76-4ee7-81e5-2a82fc354c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:21.123961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b573f-de76-4ee7-81e5-2a82fc354c4c service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:21.124253 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b573f-de76-4ee7-81e5-2a82fc354c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:21.129122 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b573f-de76-4ee7-81e5-2a82fc354c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:21.180979 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b573f-de76-4ee7-81e5-2a82fc354c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:21.182404 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b573f-de76-4ee7-81e5-2a82fc354c4c service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:21.191882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1399/2818] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:30.879616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:31.187257 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=34 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:38.579730 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:38.640419 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52553b6-399b-4703-b009-285908190c51 service cinder] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:38.645598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:38.646451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:38.646732 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:38.647008 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] PATH_INFO: `/v3/users/ac64da378d5f4d59ada565063d275364` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:38.648212 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac64da378d5f4d59ada565063d275364)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:38.650102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:38.789659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac64da378d5f4d59ada565063d275364'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:38.790304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac64da378d5f4d59ada565063d275364'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:38.790913 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac64da378d5f4d59ada565063d275364'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:38.804249 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac64da378d5f4d59ada565063d275364'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:38.810943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac64da378d5f4d59ada565063d275364'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:38.867091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1420/2819] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:02:38 2022] DELETE /identity/v3/users/ac64da378d5f4d59ada565063d275364 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:38.871660 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:38.872173 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:38.872283 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:38.891787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:38.892947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:38.950551 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1400/2820] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:38.961555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:38.963034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:39.020314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a1de0-6e18-4bd3-a7a3-1140ae9f546a admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:39.023894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:39.024564 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:39.024846 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:39.025115 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:39.033939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:39.035454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:39.044743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1421/2821] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:39.451790 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:39.456662 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:39.465864 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4b3c-f6e8-4ac0-961d-f36057dd2100 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:39.471073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:39.471476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:39.472588 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:39.472934 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] PATH_INFO: `/v3/projects/7b63126fd5a24dad9a09bccfb2956f46` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:39.474139 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b63126fd5a24dad9a09bccfb2956f46)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:39.476204 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:39.582141 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b63126fd5a24dad9a09bccfb2956f46', 'request_id': 'req-c5c79ef9-6e26-4410-a4db-bd796d555afb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.587501 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b63126fd5a24dad9a09bccfb2956f46', 'request_id': 'req-c5c79ef9-6e26-4410-a4db-bd796d555afb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.593509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b63126fd5a24dad9a09bccfb2956f46', 'request_id': 'req-c5c79ef9-6e26-4410-a4db-bd796d555afb'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.655746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] The token cache is being invalidate because project 7b63126fd5a24dad9a09bccfb2956f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:02:39.656100 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.656738 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.658265 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1401/2822] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:02:39 2022] DELETE /identity/v3/projects/7b63126fd5a24dad9a09bccfb2956f46 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 13:02:39.662395 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:39.672193 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5cab-3ec0-4df7-88e7-925a949b0fe3 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:39.690444 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:39.728304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:39.729173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:39.729450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:39.729728 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] PATH_INFO: `/v3/users/aa348abc0fc74cbaa7c4c900f7807ec7` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:39.730900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa348abc0fc74cbaa7c4c900f7807ec7)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:39.732881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:39.925925 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa348abc0fc74cbaa7c4c900f7807ec7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.926555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa348abc0fc74cbaa7c4c900f7807ec7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.927151 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa348abc0fc74cbaa7c4c900f7807ec7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.939539 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa348abc0fc74cbaa7c4c900f7807ec7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:39.946121 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-4d631388-8715-473d-afcc-6727f389471e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa348abc0fc74cbaa7c4c900f7807ec7'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:40.004204 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1422/2823] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:02:39 2022] DELETE /identity/v3/users/aa348abc0fc74cbaa7c4c900f7807ec7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:40.395534 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:40.396987 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:40.410923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c79ef9-6e26-4410-a4db-bd796d555afb admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:40.467720 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:40.468560 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:40.468843 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:40.469116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] PATH_INFO: `/v3/projects/fcd7b2cdfd624b9b9e0186bdf11278c2` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:40.470315 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd7b2cdfd624b9b9e0186bdf11278c2)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:40.472285 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:40.582167 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:40.597815 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd7b2cdfd624b9b9e0186bdf11278c2', 'request_id': 'req-07be195d-6966-4b0e-a3bf-af1b968becf2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:40.603248 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd7b2cdfd624b9b9e0186bdf11278c2', 'request_id': 'req-07be195d-6966-4b0e-a3bf-af1b968becf2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:40.609426 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd7b2cdfd624b9b9e0186bdf11278c2', 'request_id': 'req-07be195d-6966-4b0e-a3bf-af1b968becf2'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:40.712948 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] The token cache is being invalidate because project fcd7b2cdfd624b9b9e0186bdf11278c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:02:40.713239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:40.713874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-07be195d-6966-4b0e-a3bf-af1b968becf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:40.715431 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1402/2824] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:02:40 2022] DELETE /identity/v3/projects/fcd7b2cdfd624b9b9e0186bdf11278c2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:40.722499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:40.722499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:40.722499 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:40.743210 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:40.744446 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:40.803476 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1423/2825] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:40.811236 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:40.811527 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:40.811806 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:40.833063 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:40.834268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:40.842096 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1403/2826] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:40.846282 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:40.856102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ae584-fee5-4bc5-b5bf-db928d095330 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:40.860681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:40.861328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:40.861611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:40.861887 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:40.863160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80497) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 13:02:40.863467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:40.865093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:40.876381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1424/2827] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 13:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 13:02:40.881518 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:40.890831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7ca7d-c07e-4090-9b52-485a7d4d7fe5 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:40.895591 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:40.896268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:40.896547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:40.896839 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:40.897528 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:40.899398 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:40.989286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1404/2828] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:02:40 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:40.993685 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:41.003724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e1f0d-cc56-476d-b941-9352f39851ee admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:41.028900 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:41.059801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:41.060497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:41.060800 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:41.061078 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] PATH_INFO: `/v3/users` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:41.061778 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:41.063722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:41.130074 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1425/2829] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:02:40 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:41.134254 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:41.146818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6700b2d-5b95-4d64-9584-19b771180340 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:41.151446 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:41.152184 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:41.152467 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:41.152743 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:41.153469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:41.155069 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:41.166421 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1405/2830] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:02:41.170473 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:41.181101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4fbb9-51c2-413b-835a-b54d1c466dbe admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:41.186090 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9c477-4eac-4085-b422-a9d645ec5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:41.186762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c477-4eac-4085-b422-a9d645ec5e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:41.187045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c477-4eac-4085-b422-a9d645ec5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:41.187317 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9c477-4eac-4085-b422-a9d645ec5e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:41.188094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9c477-4eac-4085-b422-a9d645ec5e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:41.189725 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9c477-4eac-4085-b422-a9d645ec5e83 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:41.200388 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1426/2831] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:02:41.204481 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:41.215116 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b3f5d-5a0d-4df6-84f1-8ef15a22994d admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:41.219856 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:41.220748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:41.221031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:41.221305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] PATH_INFO: `/v3/projects/c1f9c58dc8c94c1e9ab0d7224a099de0/users/4ca361bbfade419984206761d1959aae/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:41.235376 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f9c58dc8c94c1e9ab0d7224a099de0, user_id=4ca361bbfade419984206761d1959aae, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:41.238256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:41.300985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1406/2832] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:02:41 2022] PUT /identity/v3/projects/c1f9c58dc8c94c1e9ab0d7224a099de0/users/4ca361bbfade419984206761d1959aae/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:41.311453 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:41.311738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:41.312049 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:41.340034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] MFA Rules not processed for user `4ca361bbfade419984206761d1959aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:41.341227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:41.403342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1427/2833] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:41.414310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:41.416034 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:41.475748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55736c4-2bcf-4780-ac79-ab8f822f5778 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:41.479480 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:41.480148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:41.480430 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:41.480703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:41.489579 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:41.490990 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:41.499546 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1407/2834] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:50.906886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:50.908379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:50.979827 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1197dc-fc26-40e0-b3c0-a6651309593e None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:50.984958 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:50.988451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:50.988451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:50.988451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:50.989174 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:51.000698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:51.002276 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e1657-1093-47dc-85f0-1fe458af0109 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:51.012622 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1428/2835] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:02:51.495706 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:53.007656 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:53.068578 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba0fa-3d49-40f6-a087-501793af8123 service cinder] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:53.073038 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:53.073892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:53.074171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:53.074439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] PATH_INFO: `/v3/users/4ca361bbfade419984206761d1959aae` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:53.075610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca361bbfade419984206761d1959aae)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:53.077532 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:53.228774 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca361bbfade419984206761d1959aae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:53.229429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca361bbfade419984206761d1959aae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:53.230032 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca361bbfade419984206761d1959aae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:53.242045 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca361bbfade419984206761d1959aae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:53.248865 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca361bbfade419984206761d1959aae'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:53.295182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1408/2836] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:02:53 2022] DELETE /identity/v3/users/4ca361bbfade419984206761d1959aae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:53.300283 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:53.300792 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:53.301039 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:53.319883 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:53.321113 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:53.341271 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:53.380843 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1429/2837] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:53.390500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:53.391890 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:53.449957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49246de-8057-4194-b4b7-e1b335b74fba admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:53.453598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab803f58-db1b-4808-aa1d-f0e40b49a5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:53.454223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803f58-db1b-4808-aa1d-f0e40b49a5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:53.454507 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803f58-db1b-4808-aa1d-f0e40b49a5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:53.454779 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab803f58-db1b-4808-aa1d-f0e40b49a5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:53.464252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab803f58-db1b-4808-aa1d-f0e40b49a5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:53.465677 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab803f58-db1b-4808-aa1d-f0e40b49a5e5 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:53.475556 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1409/2838] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 13:02:53.920482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:53.921981 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:53.934328 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169d09d-e4d3-4de0-8bef-2199f1f1f4ac None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:53.938932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:53.939834 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:53.940659 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:53.941022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] PATH_INFO: `/v3/projects/c1f9c58dc8c94c1e9ab0d7224a099de0` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:53.943342 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f9c58dc8c94c1e9ab0d7224a099de0)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:53.945295 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.067540 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f9c58dc8c94c1e9ab0d7224a099de0', 'request_id': 'req-a734812e-2f02-4244-80f7-bba54f20b951'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:54.073045 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f9c58dc8c94c1e9ab0d7224a099de0', 'request_id': 'req-a734812e-2f02-4244-80f7-bba54f20b951'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:54.157625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f9c58dc8c94c1e9ab0d7224a099de0', 'request_id': 'req-a734812e-2f02-4244-80f7-bba54f20b951'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:54.170091 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] The token cache is being invalidate because project c1f9c58dc8c94c1e9ab0d7224a099de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:02:54.170315 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:54.170959 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-a734812e-2f02-4244-80f7-bba54f20b951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:02:54.172529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1430/2839] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:02:53 2022] DELETE /identity/v3/projects/c1f9c58dc8c94c1e9ab0d7224a099de0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:54.177786 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.178307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.178307 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.197448 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:54.198637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:54.215436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:54.256300 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1410/2840] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:54.265651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.265939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.266218 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.286755 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:54.287983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:54.296010 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1431/2841] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:54.300281 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.309978 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8251-9694-439e-90c8-9854a6335f4c None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:54.314638 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:54.315286 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.315571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.315974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.316701 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 13:02:54.317012 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:54.318600 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.330397 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1411/2842] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 13:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 13:02:54.335330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.344487 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871da97-ddb5-4a91-9378-20e69d514ed9 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:54.349729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:54.350363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.350645 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.350918 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.351609 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:54.353545 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.441231 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1432/2843] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:02:54 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:54.444961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.454940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c497f-916b-4ebd-b610-0a1be96cdf34 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:54.520389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:54.521099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.521389 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.521727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.522444 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:54.524636 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.673788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1412/2844] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:02:54 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:02:54.678102 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.688642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574942b-0708-4798-9407-0e5eca7bbd34 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:54.694840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:54.695460 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.695942 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.696245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.696983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:54.698603 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.709470 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1433/2845] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:02:54.713524 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.724332 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c65646-d202-44f2-845a-9cd3b759d411 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:54.728905 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03958935-1b40-4870-8c54-4197a840866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:54.729564 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958935-1b40-4870-8c54-4197a840866f admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.729845 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958935-1b40-4870-8c54-4197a840866f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.730119 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03958935-1b40-4870-8c54-4197a840866f admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.730834 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958935-1b40-4870-8c54-4197a840866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:54.732439 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03958935-1b40-4870-8c54-4197a840866f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.744288 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1413/2846] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 13:02:54.748425 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.758522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9780d-1dbf-40c2-a7a8-6fa83ea50602 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:54.763280 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:54.764162 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.764465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.764740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] PATH_INFO: `/v3/projects/1337ddefe4d745aa99263d57d5faaa3a/users/22212ec626ee49a28afead21c008ddb0/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.780095 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1337ddefe4d745aa99263d57d5faaa3a, user_id=22212ec626ee49a28afead21c008ddb0, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:54.782703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:54.861788 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1434/2847] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:02:54 2022] PUT /identity/v3/projects/1337ddefe4d745aa99263d57d5faaa3a/users/22212ec626ee49a28afead21c008ddb0/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:02:54.872482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:54.872896 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:54.873183 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:54.900907 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] MFA Rules not processed for user `22212ec626ee49a28afead21c008ddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:02:54.902105 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:54.965419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1414/2848] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:02:54.977672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:02:54.979355 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:02:55.031780 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:02:55.037672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d07cdc-e844-48d4-8d9f-22add793fb87 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:02:55.041287 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58341d7e-3a2b-4685-9d11-9f503af8ea69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '750b39980ed14876879b80fe6ca61482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:02:55.047698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341d7e-3a2b-4685-9d11-9f503af8ea69 service cinder] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:02:55.047698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341d7e-3a2b-4685-9d11-9f503af8ea69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:02:55.047698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58341d7e-3a2b-4685-9d11-9f503af8ea69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:02:55.050613 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341d7e-3a2b-4685-9d11-9f503af8ea69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:02:55.052062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58341d7e-3a2b-4685-9d11-9f503af8ea69 service cinder] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:02:55.060713 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1435/2849] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:02:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:03:01.000814 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:01.020239 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:01.062887 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d34d-b6c7-4e0b-81f1-b508a84d0dea None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:01.067407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:01.068312 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:01.068581 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:01.068854 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] PATH_INFO: `/v3/users/22212ec626ee49a28afead21c008ddb0` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:01.070031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22212ec626ee49a28afead21c008ddb0)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:01.071959 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:01.251874 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22212ec626ee49a28afead21c008ddb0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:01.253127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22212ec626ee49a28afead21c008ddb0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:01.253811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22212ec626ee49a28afead21c008ddb0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:01.265827 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22212ec626ee49a28afead21c008ddb0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:01.273270 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22212ec626ee49a28afead21c008ddb0'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:01.358571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1415/2850] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:03:00 2022] DELETE /identity/v3/users/22212ec626ee49a28afead21c008ddb0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:03:01.363066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:01.363529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:01.363628 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:01.382670 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:01.394672 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:01.443250 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1436/2851] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:01.452930 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:01.454384 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:01.512997 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78602f-ebd7-4587-9e0a-3419657d6036 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:01.516613 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899861e-c61d-4b42-9b72-54865c8e83e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:01.517319 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899861e-c61d-4b42-9b72-54865c8e83e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:01.517605 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899861e-c61d-4b42-9b72-54865c8e83e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:01.517884 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899861e-c61d-4b42-9b72-54865c8e83e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:01.528271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899861e-c61d-4b42-9b72-54865c8e83e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:01.529695 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899861e-c61d-4b42-9b72-54865c8e83e7 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:01.539639 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1416/2852] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:03:01.914997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:01.916506 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:01.929438 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5849ed-8f51-4bad-b5b8-ac1d6235b1b3 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:01.934136 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:01.935035 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:01.935319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:01.935591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] PATH_INFO: `/v3/projects/1337ddefe4d745aa99263d57d5faaa3a` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:01.936813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1337ddefe4d745aa99263d57d5faaa3a)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:01.938738 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.026829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1337ddefe4d745aa99263d57d5faaa3a', 'request_id': 'req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:02.032269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1337ddefe4d745aa99263d57d5faaa3a', 'request_id': 'req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:02.088921 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1337ddefe4d745aa99263d57d5faaa3a', 'request_id': 'req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:02.100450 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] The token cache is being invalidate because project 1337ddefe4d745aa99263d57d5faaa3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:03:02.101536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:02.101536 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-3eab8adf-ab77-4a4d-b6e2-e90ef12947a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:03:02.102930 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1437/2853] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:03:01 2022] DELETE /identity/v3/projects/1337ddefe4d745aa99263d57d5faaa3a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:03:02.107859 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.108372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.108482 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.129271 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:02.130704 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:02.165358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:02.191261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1417/2854] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:02.200085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.200478 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.200756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.221879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:02.223258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:02.231122 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1438/2855] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:02.235380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.245755 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e867c-6f99-49a5-83e4-532b3269a33a None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.250513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.251177 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.251731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.252042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.252920 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 13:03:02.253282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.254888 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.266496 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1418/2856] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 13:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 13:03:02.270705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.279742 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0538-d26f-4d50-81c3-68d2eaa3e0a7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.285469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.286106 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.286387 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.286661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.287348 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.289256 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.400708 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1439/2857] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:03:02 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 13:03:02.404654 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.415234 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efd91c-d977-4868-9393-bd402c647598 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.472018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.472686 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.472970 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.473247 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.473947 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.475963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.564011 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1419/2858] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:03:02 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:03:02.568363 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.578783 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e47345-3398-4b92-941e-4fc785a32d19 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.583962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.584612 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.584892 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.585163 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.585909 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.587486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.597973 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1440/2859] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:03:02.601858 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.612241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412b84d-7c6d-4ee8-9ced-ad20cef990f1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.617464 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba6b59-c68a-4849-b901-5102e578ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.618118 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba6b59-c68a-4849-b901-5102e578ad9c admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.618405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba6b59-c68a-4849-b901-5102e578ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.618703 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba6b59-c68a-4849-b901-5102e578ad9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.619407 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba6b59-c68a-4849-b901-5102e578ad9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.621037 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba6b59-c68a-4849-b901-5102e578ad9c admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.631672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1420/2860] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:03:02.635886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.646465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ed0e6-5da9-42f9-b735-6ddb05f3ce43 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.651076 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.651874 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.652191 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.652467 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] PATH_INFO: `/v3/projects/d759c68060c14d49a3493a1affa3402c/users/48ea9e513b69430dac910e91fe5c513b/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.667269 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d759c68060c14d49a3493a1affa3402c, user_id=48ea9e513b69430dac910e91fe5c513b, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.669907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.758330 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1441/2861] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:03:02 2022] PUT /identity/v3/projects/d759c68060c14d49a3493a1affa3402c/users/48ea9e513b69430dac910e91fe5c513b/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:03:02.763712 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4b6b2-a61a-4ede-9ee3-8f0f0aba138a None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.764009 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4b6b2-a61a-4ede-9ee3-8f0f0aba138a None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.764292 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4b6b2-a61a-4ede-9ee3-8f0f0aba138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.783347 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-1ab4b6b2-a61a-4ede-9ee3-8f0f0aba138a None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:02.785305 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-1ab4b6b2-a61a-4ede-9ee3-8f0f0aba138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:02.842935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1421/2862] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:02.852939 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:02.854619 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:02.866310 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:02.912222 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dda98-f15b-4402-9505-9b76c2636e41 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:02.915907 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:02.916600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:02.916880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:02.917153 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:02.927094 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:02.928555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:02.938377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1442/2863] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:03:08.379886 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.380408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.380538 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.407565 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] MFA Rules not processed for user `48ea9e513b69430dac910e91fe5c513b`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:08.408984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:08.444563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:08.476018 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1422/2864] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:08.480530 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:08.491600 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d0ab3-eb0d-4337-85a7-08e09324fd8f service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:08.496481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:08.497181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.497454 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.497729 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.498430 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:08.500418 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:08.559862 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1443/2865] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:03:08 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:03:08.564121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:08.574805 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61cee-5a6e-49c3-9abc-6070325cf9f0 None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:08.634121 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:08.634799 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.635070 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.635338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.636311 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:08.638295 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:08.725554 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1423/2866] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:03:08 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 13:03:08.729568 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:08.743822 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a38cb4-db5c-4bb5-bf11-f769684ff9d0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:08.745648 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:08.746322 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.746608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.746885 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.747611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:08.749286 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:08.761308 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1444/2867] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:03:08.765837 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:08.776425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cfca3-f294-4cfd-8337-d051e504b72f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:08.785358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:08.785358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.785358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.785358 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] PATH_INFO: `/v3/projects/38ad12b09df841bc8cee27f714197693/users/7667561ce1324b58a17bd172359f04cc/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.797494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad12b09df841bc8cee27f714197693, user_id=7667561ce1324b58a17bd172359f04cc, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:08.800962 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:08.874212 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1424/2868] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:03:08 2022] PUT /identity/v3/projects/38ad12b09df841bc8cee27f714197693/users/7667561ce1324b58a17bd172359f04cc/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:03:08.878332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:08.891908 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73452d0-4813-49f0-a8be-fac193a086a0 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:08.955549 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b11e7e-aa60-48ab-a693-1a7b57de6e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:08.956496 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b11e7e-aa60-48ab-a693-1a7b57de6e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.956847 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b11e7e-aa60-48ab-a693-1a7b57de6e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.957196 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b11e7e-aa60-48ab-a693-1a7b57de6e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.957983 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b11e7e-aa60-48ab-a693-1a7b57de6e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:08.959654 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b11e7e-aa60-48ab-a693-1a7b57de6e51 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:08.970275 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1445/2869] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:03:08.975231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:08.985673 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78623fd4-9480-4758-94d8-207410aa80c6 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:08.990791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:08.991683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:08.991985 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:08.992262 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] PATH_INFO: `/v3/projects/38ad12b09df841bc8cee27f714197693/users/7667561ce1324b58a17bd172359f04cc/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:08.994252 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ad12b09df841bc8cee27f714197693, user_id=7667561ce1324b58a17bd172359f04cc, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:08.996986 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:09.008612 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1425/2870] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:03:08 2022] PUT /identity/v3/projects/38ad12b09df841bc8cee27f714197693/users/7667561ce1324b58a17bd172359f04cc/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 13:03:14.483319 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b4971-d809-4098-9146-fcbd910a1d69 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:14.484313 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b4971-d809-4098-9146-fcbd910a1d69 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:14.484665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b4971-d809-4098-9146-fcbd910a1d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:14.517125 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3b8b4971-d809-4098-9146-fcbd910a1d69 None None] MFA Rules not processed for user `7667561ce1324b58a17bd172359f04cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:14.518607 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3b8b4971-d809-4098-9146-fcbd910a1d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:14.586698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:14.590515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1446/2871] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:14.603163 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:14.604929 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:14.688747 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801fcea-6514-4571-8230-633e514647c1 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:14.692523 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06abb3c5b9f842fca49b9a44e7feb99d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:14.693170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:14.693450 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:14.693727 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:14.714004 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:14.751318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:14.752988 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:14.762360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1426/2872] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:03:15.017034 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9f36-0b5e-41c9-808e-c80315a73d03 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:15.017384 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9f36-0b5e-41c9-808e-c80315a73d03 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:15.017818 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa9f36-0b5e-41c9-808e-c80315a73d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:15.039745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-70aa9f36-0b5e-41c9-808e-c80315a73d03 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:15.041062 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-70aa9f36-0b5e-41c9-808e-c80315a73d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:15.100669 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1447/2873] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:15.254544 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:15.256016 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:15.341728 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c175b0-ba6f-4f41-b77b-601e7c690123 service glance] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:15.347487 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:15.348195 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:15.348475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:15.348746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:15.357901 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:15.359633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:15.368310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1427/2874] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 13:03:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:25.093041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:25.364961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=54 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:25.842616 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1da3-13ce-4d62-80b1-6eebd71a92ec None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:25.842903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1da3-13ce-4d62-80b1-6eebd71a92ec None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:25.843181 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce1da3-13ce-4d62-80b1-6eebd71a92ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:25.862838 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3bce1da3-13ce-4d62-80b1-6eebd71a92ec None None] MFA Rules not processed for user `48ea9e513b69430dac910e91fe5c513b`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:25.864093 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3bce1da3-13ce-4d62-80b1-6eebd71a92ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:25.870946 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1448/2875] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:26.128418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:26.129849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:26.185603 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcabb7-250c-4008-9077-24f100e88b88 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:26.189144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:26.189782 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:26.190061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:26.190338 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:26.192104 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:26.201418 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:26.202943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:26.211256 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1428/2876] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:03:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:03:29.630829 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:29.632258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:29.632258 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:29.652372 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:03:29.653592 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:29.661635 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1449/2877] 10.222.0.45 () {58 vars in 1009 bytes} [Mon Jul 25 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:03:29.674425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:29.687324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093d2f-a56a-4a6e-8030-1343b9c28f9d service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:29.693261 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:29.693994 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:29.694343 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:29.694689 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:29.703400 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:29.705715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:29.714304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1429/2878] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 13:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 13:03:39.646302 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:39.710813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=32 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:03:53.256394 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:53.267131 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c31c-a38f-46b1-a243-994184eb185c None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:53.270750 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:53.271382 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:53.271661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:53.271952 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:53.282061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:53.283494 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:53.293554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1450/2879] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:03:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:03:58.471202 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:03:58.473892 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:58.619642 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda9a00-6584-4a66-a1bb-108951a6f0dc service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:03:58.629085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:03:58.632748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:03:58.632748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:03:58.632748 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:03:58.633083 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:03:58.651144 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:03:58.653042 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:03:58.670943 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1430/2880] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:03:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:04:03.289022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:04:08.664672 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=34 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:12.923752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:12.933304 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222fef5-8958-4fc9-ad51-b482316fb181 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:12.936850 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:12.937469 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:12.937748 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:12.938168 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:12.939949 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:12.954972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:12.954972 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476ce17-7ba7-421a-8ab1-f539778d179d service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:12.965899 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1451/2881] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:05:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:05:19.250582 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:19.261268 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8eee7-a658-4243-9dfd-396c8e5e7c9f service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:19.265176 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:19.265813 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:19.266099 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:19.266380 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:19.268211 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:19.282106 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:19.283539 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:19.295073 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1431/2882] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:05:22.906951 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:22.907463 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:22.907608 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:22.927830 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] MFA Rules not processed for user `5d4c20c5feaa4da8835fa8b5ffc1ac9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:22.929089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:22.936369 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1452/2883] 10.222.0.45 () {58 vars in 967 bytes} [Mon Jul 25 13:05:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:05:22.979683 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:22.991458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813781b-5bbf-46a6-a4d2-988774035f2a service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:22.996408 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '137aecde49064a4abf74de30e9a85875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:22.997043 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:22.997322 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:22.997598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:23.008883 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:23.010458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:23.018746 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1432/2884] 10.222.0.45 () {60 vars in 1384 bytes} [Mon Jul 25 13:05:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 13:05:31.327877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:31.327877 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:31.404383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37f778-a881-4e2d-9e73-a01b3050b122 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:31.410114 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:31.411318 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:31.411604 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:31.411879 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:31.413801 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:31.426993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:31.428753 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:31.439182 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1453/2885] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:05:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:05:31.472939 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:31.538687 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd555c-614e-491f-a0cd-12a27ceeb095 service swift] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:31.543140 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:31.544059 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:31.544326 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:31.544599 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] PATH_INFO: `/v3/users/48ea9e513b69430dac910e91fe5c513b` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:31.545850 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ea9e513b69430dac910e91fe5c513b)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:31.547841 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:31.743230 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ea9e513b69430dac910e91fe5c513b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:31.743961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ea9e513b69430dac910e91fe5c513b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:31.744571 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ea9e513b69430dac910e91fe5c513b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:31.757810 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ea9e513b69430dac910e91fe5c513b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:31.764878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ea9e513b69430dac910e91fe5c513b'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:31.847963 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1433/2886] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:05:31 2022] DELETE /identity/v3/users/48ea9e513b69430dac910e91fe5c513b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:05:32.106229 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:32.117224 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fee21-b82d-461a-a897-cb688f822c14 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:32.175770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:32.176642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:32.176924 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:32.177199 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] PATH_INFO: `/v3/projects/d759c68060c14d49a3493a1affa3402c` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:32.178368 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d759c68060c14d49a3493a1affa3402c)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:32.180284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:32.304962 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd759c68060c14d49a3493a1affa3402c', 'request_id': 'req-0cd379b9-ea64-4761-a807-754d4798d38e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.310481 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd759c68060c14d49a3493a1affa3402c', 'request_id': 'req-0cd379b9-ea64-4761-a807-754d4798d38e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.390752 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd759c68060c14d49a3493a1affa3402c', 'request_id': 'req-0cd379b9-ea64-4761-a807-754d4798d38e'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.398955 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:32.402624 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] The token cache is being invalidate because project d759c68060c14d49a3493a1affa3402c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:05:32.402914 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.408433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.408433 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1454/2887] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:05:32 2022] DELETE /identity/v3/projects/d759c68060c14d49a3493a1affa3402c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 13:05:32.409876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:32.411298 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:32.424452 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64fc81-38b7-4882-bb5f-03196e6c113f admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:32.473425 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:32.482301 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:32.483178 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:32.483458 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:32.483731 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] PATH_INFO: `/v3/users/7667561ce1324b58a17bd172359f04cc` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:32.484980 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7667561ce1324b58a17bd172359f04cc)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:32.487025 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:32.665576 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7667561ce1324b58a17bd172359f04cc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.666186 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7667561ce1324b58a17bd172359f04cc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.666801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7667561ce1324b58a17bd172359f04cc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.678369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7667561ce1324b58a17bd172359f04cc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.685125 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-fd6b7e14-b612-46e1-bd9c-24b6998df453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7667561ce1324b58a17bd172359f04cc'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:32.767946 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1434/2888] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:05:32 2022] DELETE /identity/v3/users/7667561ce1324b58a17bd172359f04cc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 13:05:33.030808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.032451 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:33.048709 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd379b9-ea64-4761-a807-754d4798d38e admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.106724 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.107583 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.107869 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.108176 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] PATH_INFO: `/v3/projects/38ad12b09df841bc8cee27f714197693` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.109360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ad12b09df841bc8cee27f714197693)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.111257 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.207128 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ad12b09df841bc8cee27f714197693', 'request_id': 'req-c1e55c67-4d32-4ff0-b67d-8813447c2bad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:33.212529 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ad12b09df841bc8cee27f714197693', 'request_id': 'req-c1e55c67-4d32-4ff0-b67d-8813447c2bad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:33.270605 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ad12b09df841bc8cee27f714197693', 'request_id': 'req-c1e55c67-4d32-4ff0-b67d-8813447c2bad'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:33.283770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] The token cache is being invalidate because project 38ad12b09df841bc8cee27f714197693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80497) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:05:33.283770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:33.283770 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-c1e55c67-4d32-4ff0-b67d-8813447c2bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:05:33.284129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1455/2889] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:05:33 2022] DELETE /identity/v3/projects/38ad12b09df841bc8cee27f714197693 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:05:33.289632 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.289923 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.290200 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.311419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:33.312650 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:33.370694 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1435/2890] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:05:33.379343 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.379634 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.379938 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.400040 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:33.401233 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:33.409190 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1456/2891] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:05:33.413811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.423370 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a0ed2-9955-4612-a43b-9fad6ffbb99d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.428000 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.428652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.428932 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.429206 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.429925 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80496) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 13:05:33.430231 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.431818 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.443215 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1436/2892] 10.222.0.45 () {58 vars in 1153 bytes} [Mon Jul 25 13:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 13:05:33.447381 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.457101 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d8bc-ccc3-45de-950c-c990c46ae068 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.461840 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.462486 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.462767 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.463043 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.463740 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.465703 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.578894 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1457/2893] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:05:33 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 13:05:33.583171 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.593170 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1b40b-173e-497f-8f12-b80a77fadb68 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.649304 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.650078 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.650360 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.650633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.651323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.653255 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.661919 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:33.738598 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1437/2894] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:05:33 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:05:33.743012 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.753902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3a8b3-48fe-4728-a5ea-ff7c314e9196 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.758768 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.759462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.759743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.760061 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.760851 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.762734 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.772841 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1458/2895] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:05:33.776820 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.787323 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffd9e1-da02-4d2f-93b5-f53b6d0e583b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.791849 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e004a-2a22-4ff6-af1e-3ec2248e2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.793435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e004a-2a22-4ff6-af1e-3ec2248e2948 admin admin] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.793435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e004a-2a22-4ff6-af1e-3ec2248e2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.793435 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e004a-2a22-4ff6-af1e-3ec2248e2948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.793872 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e004a-2a22-4ff6-af1e-3ec2248e2948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.795447 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e004a-2a22-4ff6-af1e-3ec2248e2948 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.806513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1438/2896] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:05:33.810698 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:33.821223 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43035bc-66ce-4d47-b0dc-541daaa07b97 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:33.826277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:33.827554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.827554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.827859 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] PATH_INFO: `/v3/projects/d9cd1057f9de48f8845dfac24a97779e/users/d61c219db1d043919f7ad09a98d7bfba/roles/cacd3e0b20764818bd998ab848b2a854` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.843593 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cd1057f9de48f8845dfac24a97779e, user_id=d61c219db1d043919f7ad09a98d7bfba, role_id=cacd3e0b20764818bd998ab848b2a854)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:33.846333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:33.950932 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1459/2897] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:05:33 2022] PUT /identity/v3/projects/d9cd1057f9de48f8845dfac24a97779e/users/d61c219db1d043919f7ad09a98d7bfba/roles/cacd3e0b20764818bd998ab848b2a854 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:05:33.956148 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81119fe-1a48-4aac-83ae-1011166821c6 None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:33.957031 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81119fe-1a48-4aac-83ae-1011166821c6 None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:33.957299 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81119fe-1a48-4aac-83ae-1011166821c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:33.976427 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-a81119fe-1a48-4aac-83ae-1011166821c6 None None] MFA Rules not processed for user `98bd6a1dc7ae4125860c8750461c1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:33.977630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a81119fe-1a48-4aac-83ae-1011166821c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:34.036519 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1439/2898] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 13:05:34.046173 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:34.047886 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:34.078245 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:34.105589 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef571f-27f9-4141-8009-d5a39182e1e6 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:34.109733 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:34.110380 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:34.110665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:34.110943 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:34.120533 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:34.121997 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:34.131515 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1460/2899] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 13:05:39.480715 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:39.481313 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:39.481504 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:39.513369 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] MFA Rules not processed for user `d61c219db1d043919f7ad09a98d7bfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:39.514618 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:39.587895 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1440/2900] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:05:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:05:39.592743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:39.603165 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000324a2-b885-4c58-8b2d-d05a5a0072a1 service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:39.607706 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:39.608385 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:39.608671 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:39.608950 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:39.609680 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:39.611579 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:39.764789 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1461/2901] 10.222.0.45 () {60 vars in 1153 bytes} [Mon Jul 25 13:05:39 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:05:39.769033 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:39.779637 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ba485-38ae-4c73-be8e-913df2365d9d None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:39.834416 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:39.835085 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:39.835372 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:39.835649 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] PATH_INFO: `/v3/users` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:39.836390 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:39.838308 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:39.911475 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:39.917233 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1441/2902] 10.222.0.45 () {60 vars in 1144 bytes} [Mon Jul 25 13:05:39 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 13:05:39.921471 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:39.932705 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf17a4-80bb-4a42-a973-f7ab63bfceb5 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:39.937443 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:39.938201 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:39.938482 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:39.938761 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:39.939532 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:39.941646 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:39.952491 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1462/2903] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:05:39.957437 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:39.967778 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edd7aa-86af-4336-a700-e38d65edf15b admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:39.972787 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:39.973671 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:39.973954 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:39.974223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] PATH_INFO: `/v3/projects/48ae25bb8f9b4b8ab1b8e1489896df9b/users/db35b4857aaa4ef5b6f6ce33f010768d/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:39.990350 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae25bb8f9b4b8ab1b8e1489896df9b, user_id=db35b4857aaa4ef5b6f6ce33f010768d, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:39.993040 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:40.083340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1442/2904] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:05:39 2022] PUT /identity/v3/projects/48ae25bb8f9b4b8ab1b8e1489896df9b/users/db35b4857aaa4ef5b6f6ce33f010768d/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 13:05:40.087416 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:40.098413 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd628-1d66-4794-a6fd-79deb8c40f63 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:40.161657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007c5d-772e-40dc-9e2e-7ca55f75835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:40.162353 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007c5d-772e-40dc-9e2e-7ca55f75835b admin admin] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:40.162631 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007c5d-772e-40dc-9e2e-7ca55f75835b admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:40.162901 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007c5d-772e-40dc-9e2e-7ca55f75835b admin admin] PATH_INFO: `/v3/roles` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:40.163651 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007c5d-772e-40dc-9e2e-7ca55f75835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:40.165288 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007c5d-772e-40dc-9e2e-7ca55f75835b admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:40.175556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1463/2905] 10.222.0.45 () {58 vars in 1122 bytes} [Mon Jul 25 13:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 13:05:40.179878 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:40.190136 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059773-77e9-417c-8c78-14d827c1e77a admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:40.195832 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:40.196763 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:40.197047 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:40.197340 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] PATH_INFO: `/v3/projects/48ae25bb8f9b4b8ab1b8e1489896df9b/users/db35b4857aaa4ef5b6f6ce33f010768d/roles/add2d1a8e4c74bdda5ddb6a3e547e640` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:40.199419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ae25bb8f9b4b8ab1b8e1489896df9b, user_id=db35b4857aaa4ef5b6f6ce33f010768d, role_id=add2d1a8e4c74bdda5ddb6a3e547e640)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:40.202089 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:40.213180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1443/2906] 10.222.0.45 () {60 vars in 1483 bytes} [Mon Jul 25 13:05:40 2022] PUT /identity/v3/projects/48ae25bb8f9b4b8ab1b8e1489896df9b/users/db35b4857aaa4ef5b6f6ce33f010768d/roles/add2d1a8e4c74bdda5ddb6a3e547e640 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:05:45.864066 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c46a-c370-4b5c-942f-8dea60a1d04b None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:45.864556 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c46a-c370-4b5c-942f-8dea60a1d04b None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:45.864678 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921c46a-c370-4b5c-942f-8dea60a1d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:45.898661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-0921c46a-c370-4b5c-942f-8dea60a1d04b None None] MFA Rules not processed for user `db35b4857aaa4ef5b6f6ce33f010768d`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:45.898661 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0921c46a-c370-4b5c-942f-8dea60a1d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:45.977202 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1464/2907] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:05:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:05:45.992526 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:05:45.994220 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:46.070182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f007e1-715f-4f29-a364-ef0ac79da157 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:05:46.075665 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:05:46.076345 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:46.076630 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:46.076992 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:46.135309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:05:46.136935 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:05:46.147318 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1444/2908] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:05:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:05:49.879022 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:05:49.879551 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:05:49.879665 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:05:49.900976 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] MFA Rules not processed for user `d61c219db1d043919f7ad09a98d7bfba`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:05:49.902331 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:05:49.910314 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1465/2909] 10.222.0.45 () {58 vars in 958 bytes} [Mon Jul 25 13:05:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:05:56.142516 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:05:59.895516 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:09.488194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:06:09.554753 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de722e70-af37-400f-9e8e-51250d39f784 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:06:09.558908 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:06:09.559429 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:06:09.560494 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:06:09.560784 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:06:09.562792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:06:09.574026 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:06:09.575466 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:06:09.584079 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1445/2910] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:06:14.880489 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:06:14.881984 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:06:14.899640 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800b5db-7142-4452-a608-6d1bdb77d3a7 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:06:14.905903 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:06:14.906555 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:06:14.906836 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:06:14.907112 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:06:14.909794 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:06:14.922569 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:06:14.924216 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:06:14.934848 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1466/2911] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:06:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:06:18.305563 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:06:18.307182 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:06:18.318371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c6e41-04b7-4d72-b438-dd9e85f3014f service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:06:18.322187 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:06:18.322882 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:06:18.323161 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:06:18.323436 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:06:18.332623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:06:18.334086 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:06:18.344246 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1446/2912] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:06:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 13:06:24.930427 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:06:28.339610 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=32 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:07:55.035737 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:07:55.037987 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:07:55.216632 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc94ff-6b08-4bca-ac90-29b66dfc2fd8 service nova] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:07:55.222813 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:07:55.223465 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:07:55.223751 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:07:55.224633 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:07:55.226591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:07:55.244591 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:07:55.246227 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fccc7f-0671-4b0f-82a0-eba22b680948 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:07:55.258013 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1467/2913] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:07:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:08:05.252657 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=63 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:37.308597 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:08:37.339894 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb18de-6a2f-4f25-a414-12b7eca76fe5 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:08:37.343807 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:08:37.344801 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:37.344984 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:37.345196 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:37.347046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:08:37.370460 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:08:37.371903 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f823ba9-b461-4586-876a-e97929190a73 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:08:37.381044 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1447/2914] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:08:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:08:37.727774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcffeb0-7de1-44df-8989-b60ea67c9176 None None] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:37.729462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcffeb0-7de1-44df-8989-b60ea67c9176 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:37.729462 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcffeb0-7de1-44df-8989-b60ea67c9176 None None] PATH_INFO: `/` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:37.729781 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1468/2915] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 13:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 13:08:37.736221 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c124e-8ffc-43cd-b669-6ece6f616a1b None None] REQUEST_METHOD: `POST` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:37.736509 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c124e-8ffc-43cd-b669-6ece6f616a1b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:37.736788 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c124e-8ffc-43cd-b669-6ece6f616a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:37.803180 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.auth.core [None req-d41c124e-8ffc-43cd-b669-6ece6f616a1b None None] MFA Rules not processed for user `8996a1cff4474efeac1878197b5c07b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80496) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:08:37.804674 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d41c124e-8ffc-43cd-b669-6ece6f616a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:08:37.811875 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1448/2916] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:08:37.824379 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcffeb0-7de1-44df-8989-b60ea67c9176 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:08:37.835599 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcffeb0-7de1-44df-8989-b60ea67c9176 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:08:37.839146 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bad0f-ab84-4267-9935-67a9d484e086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:08:37.839774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bad0f-ab84-4267-9935-67a9d484e086 service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:37.840087 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bad0f-ab84-4267-9935-67a9d484e086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:37.840362 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bad0f-ab84-4267-9935-67a9d484e086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:37.847881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bad0f-ab84-4267-9935-67a9d484e086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:08:37.849333 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bad0f-ab84-4267-9935-67a9d484e086 service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:08:37.857774 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1469/2917] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:08:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:08:37.944623 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ebb8-fa4c-4cc0-8121-1e43196a427b None None] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:37.944949 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ebb8-fa4c-4cc0-8121-1e43196a427b None None] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:37.945229 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ebb8-fa4c-4cc0-8121-1e43196a427b None None] PATH_INFO: `/` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:37.946633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1449/2918] 10.222.0.45 () {54 vars in 921 bytes} [Mon Jul 25 13:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 13:08:37.951902 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] REQUEST_METHOD: `POST` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:37.952284 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:37.952598 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:38.005129 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.auth.core [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] MFA Rules not processed for user `62eba0e2bd914eeb949bb434f8a6cd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80497) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 13:08:38.006390 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:08:38.032370 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1470/2919] 10.222.0.45 () {58 vars in 1018 bytes} [Mon Jul 25 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 13:08:38.043833 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8ebb8-fa4c-4cc0-8121-1e43196a427b None None] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:08:38.055826 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8ebb8-fa4c-4cc0-8121-1e43196a427b None None] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:08:38.059371 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:08:38.060053 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:38.060337 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:38.060615 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:38.071477 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:08:38.072965 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:08:38.084030 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1450/2920] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:08:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:08:38.148911 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:08:38.161031 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2591ff2-bf63-4f22-9470-a9bd15fee040 None None] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:08:38.166080 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:08:38.166808 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:08:38.167089 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:08:38.167365 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:08:38.169285 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:08:38.181702 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:08:38.183357 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:08:38.193625 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1471/2921] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:08:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:08:48.079138 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=43 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:08:48.189167 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=33 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:10.805957 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:10.819955 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9673a2-fc9d-4fb6-893d-6aa4d2b60402 service neutron] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:10.826792 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62eba0e2bd914eeb949bb434f8a6cd9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:10.828333 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:10.828692 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:10.829046 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:10.831194 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:10:10.844975 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:10.846661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:10.860061 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1451/2922] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:10:12.355158 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:12.365745 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af82bbf-a980-4f17-b31c-feb9f500fe96 service placement] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:12.369360 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8996a1cff4474efeac1878197b5c07b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:12.369993 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:12.370277 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:12.370554 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:12.372383 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:10:12.388445 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:12.390364 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:12.402111 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1472/2923] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:10:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:10:20.854633 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=6 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:22.396602 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=6 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:23.453525 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:23.455041 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:10:23.472469 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cffc0-b5b7-4433-b66b-ec3a7df1c210 service nova] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:23.477678 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:23.478500 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] REQUEST_METHOD: `GET` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:23.479107 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:23.479396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:23.481310 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:10:23.496276 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:23.498127 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:23.509881 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1452/2924] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:10:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:10:23.577177 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:23.668762 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace5998-28bc-444d-b305-6013fe19d60c service neutron] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:23.674441 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:23.675332 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:23.675611 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:23.675880 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] PATH_INFO: `/v3/users/d61c219db1d043919f7ad09a98d7bfba` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:23.677117 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61c219db1d043919f7ad09a98d7bfba)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:23.679041 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:23.876756 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61c219db1d043919f7ad09a98d7bfba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:23.877397 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61c219db1d043919f7ad09a98d7bfba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:23.878042 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61c219db1d043919f7ad09a98d7bfba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:23.891764 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61c219db1d043919f7ad09a98d7bfba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:23.898681 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61c219db1d043919f7ad09a98d7bfba'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:23.979787 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1473/2925] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:10:23 2022] DELETE /identity/v3/users/d61c219db1d043919f7ad09a98d7bfba => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:10:24.267811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:24.282405 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45b610-24e0-49df-b988-d10ae51fbd58 service placement] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:24.337822 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:24.338719 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:24.339010 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:24.339282 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] PATH_INFO: `/v3/projects/d9cd1057f9de48f8845dfac24a97779e` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:24.340513 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cd1057f9de48f8845dfac24a97779e)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:24.342419 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:24.448223 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cd1057f9de48f8845dfac24a97779e', 'request_id': 'req-d9ed5b23-486e-4a60-bc78-0f1cea21e425'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.454396 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cd1057f9de48f8845dfac24a97779e', 'request_id': 'req-d9ed5b23-486e-4a60-bc78-0f1cea21e425'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.460627 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cd1057f9de48f8845dfac24a97779e', 'request_id': 'req-d9ed5b23-486e-4a60-bc78-0f1cea21e425'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.555103 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] The token cache is being invalidate because project d9cd1057f9de48f8845dfac24a97779e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:10:24.555324 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.555940 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.557476 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1453/2926] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:10:24 2022] DELETE /identity/v3/projects/d9cd1057f9de48f8845dfac24a97779e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:10:24.561548 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:24.564006 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:10:24.576979 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce91418-29fc-4c6c-bd46-7d6437a12244 admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:24.632497 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:24.633359 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:24.633642 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:24.633915 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] PATH_INFO: `/v3/users/db35b4857aaa4ef5b6f6ce33f010768d` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:24.635116 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=db35b4857aaa4ef5b6f6ce33f010768d)` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:24.637085 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:24.639743 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:24.822927 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db35b4857aaa4ef5b6f6ce33f010768d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.823534 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db35b4857aaa4ef5b6f6ce33f010768d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.824160 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db35b4857aaa4ef5b6f6ce33f010768d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.836071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db35b4857aaa4ef5b6f6ce33f010768d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.842826 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.notifications [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db35b4857aaa4ef5b6f6ce33f010768d'} {{(pid=80497) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:24.965036 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1474/2927] 10.222.0.45 () {58 vars in 1224 bytes} [Mon Jul 25 13:10:24 2022] DELETE /identity/v3/users/db35b4857aaa4ef5b6f6ce33f010768d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:10:25.213309 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Authenticating user token {{(pid=80496) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:10:25.214831 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.fernet_utils [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80496) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:10:25.227811 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed5b23-486e-4a60-bc78-0f1cea21e425 admin admin] Validating token access rules against request {{(pid=80496) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:10:25.285374 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98bd6a1dc7ae4125860c8750461c1fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '008d6127b7814e42964dd897d624be5f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80496) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:10:25.286241 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:10:25.286547 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:10:25.286828 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] PATH_INFO: `/v3/projects/48ae25bb8f9b4b8ab1b8e1489896df9b` {{(pid=80496) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:10:25.288035 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ae25bb8f9b4b8ab1b8e1489896df9b)` {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:10:25.289926 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] RBAC: Authorization granted {{(pid=80496) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:10:25.297876 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:25.431791 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ae25bb8f9b4b8ab1b8e1489896df9b', 'request_id': 'req-35351008-c39c-4805-817d-4de4c7dc1a3f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:25.437974 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ae25bb8f9b4b8ab1b8e1489896df9b', 'request_id': 'req-35351008-c39c-4805-817d-4de4c7dc1a3f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:25.444289 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ae25bb8f9b4b8ab1b8e1489896df9b', 'request_id': 'req-35351008-c39c-4805-817d-4de4c7dc1a3f'} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:25.524961 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] The token cache is being invalidate because project 48ae25bb8f9b4b8ab1b8e1489896df9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80496) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 13:10:25.525652 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:25.525912 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG keystone.notifications [None req-35351008-c39c-4805-817d-4de4c7dc1a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80496) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 13:10:25.527457 dv-cinder-825492-28-smb devstack@keystone.service[80496]: [pid: 80496|app: 0|req: 1454/2928] 10.222.0.45 () {58 vars in 1233 bytes} [Mon Jul 25 13:10:25 2022] DELETE /identity/v3/projects/48ae25bb8f9b4b8ab1b8e1489896df9b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 13:10:34.961377 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:10:35.521661 dv-cinder-825492-28-smb devstack@keystone.service[80496]: DEBUG dbcounter [-] [80496] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 13:12:57.963252 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Authenticating user token {{(pid=80497) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 13:12:57.964722 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:12:58.036576 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a409c8-eeac-4e7f-9445-fe9b2bc7e2de admin admin] Validating token access rules against request {{(pid=80497) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 13:12:58.096238 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd90a6d60fe644ab5a5c781b6348dfef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f34ac92b2d654139b1300d7a276553f1', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80497) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 13:12:58.097507 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] REQUEST_METHOD: `GET` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 13:12:58.097793 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] SCRIPT_NAME: `/identity` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 13:12:58.098071 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80497) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 13:12:58.099881 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.fernet_utils [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80497) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 13:12:58.112097 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 13:12:58.113690 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef0871-0226-42c8-8c27-6f72fb770268 service placement] RBAC: Authorization granted {{(pid=80497) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 13:12:58.125294 dv-cinder-825492-28-smb devstack@keystone.service[80497]: [pid: 80497|app: 0|req: 1475/2929] 10.222.0.45 () {60 vars in 1365 bytes} [Mon Jul 25 13:12:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 13:13:08.119522 dv-cinder-825492-28-smb devstack@keystone.service[80497]: DEBUG dbcounter [-] [80497] Writing DB stats keystone:SELECT=58 {{(pid=80497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}